Apr 07 06:00:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:00:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:00:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:00:29 devstack cinder-volume[73433]: INFO dbcounter [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Registered counter for database cinder Apr 07 06:00:29 devstack cinder-volume[73433]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:29 devstack cinder-volume[73433]: DEBUG dbcounter [-] [73433] Writer thread running {{(pid=73433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:00:29 devstack cinder-volume[73433]: INFO cinder.rpc [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:00:29 devstack cinder-volume[73433]: INFO cinder.rpc [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:30 devstack cinder-volume[73433]: INFO cinder.volume.manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Determined volume DB was empty at startup. Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG cinder.volume.manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73433) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:00:30 devstack cinder-volume[73433]: INFO cinder.volume.manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING stevedore.named [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING castellan.key_manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING cinder.keymgr.conf_key_mgr [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG cinder.volume.drivers.lvm [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73433) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_concurrency.processutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_concurrency.processutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.282s {{(pid=73433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:30 devstack cinder-volume[73433]: INFO cinder.rpc [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 07 06:00:30 devstack cinder-volume[73433]: INFO cinder.rpc [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING stevedore.named [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING castellan.key_manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:30 devstack cinder-volume[73433]: INFO cinder.volume.manager [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:30 devstack cinder-volume[73433]: INFO oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Starting 1 workers Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Started child 73541 {{(pid=73433) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Full set of CONF: {{(pid=73433) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] ******************************************************************************** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Configuration options gathered from: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] ================================================================================ {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] allow_availability_zone_fallback = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] allow_compression_on_image_upload = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] allowed_direct_url_schemes = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] api_rate_limit = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] auth_strategy = keystone {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] az_cache_duration = 3600 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_availability_zone = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_host = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_stats_polling_interval = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backup_api_class = cinder.backup.api.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backup_name_template = backup-%s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backup_use_same_host = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backup_use_temp_snapshot = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] chap_password = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] chap_username = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_internal_tenant_project_id = fc1e4f7c2260441087210b8159ec0941 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_internal_tenant_user_id = b232c2fb3f6a498ea96b5e0ff8347145 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cloned_volume_same_az = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cluster = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] compression_format = gzip {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] compute_api_class = cinder.compute.nova.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] config_dir = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] config_source = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] control_exchange = openstack {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] debug = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] default_availability_zone = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] default_group_type = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] default_volume_type = lvmdriver-1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] disk_geometry = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_client_cert = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_client_cert_key = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_data_namespace = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_ssl_cert_path = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_ssl_cert_verify = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] driver_use_ssl = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] enable_force_upload = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] enable_new_services = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] enable_unsupported_driver = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] enforce_multipath_for_image_xfer = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] filter_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_api_insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_api_ssl_compression = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_ca_certificates_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_catalog_info = image:glance:publicURL {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_num_retries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance_request_timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] goodness_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] graceful_shutdown_timeout = 5 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] group_api_class = cinder.group.api.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] host = devstack {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_compress_on_upload = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_conversion_address_space_limit = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_conversion_cpu_limit = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_conversion_disable = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: INFO cinder.volume.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_upload_use_cinder_backend = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_upload_use_internal_tenant = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_volume_cache_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_volume_cache_max_count = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] init_host_max_objects_retrieval = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] instance_format = [instance: %(uuid)s] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iscsi_target_flags = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iscsi_write_cache = on {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iser_helper = tgtadm {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iser_ip_address = 192.168.122.159 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iser_port = 3260 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_color = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_config_append = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_dir = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_options = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_rotate_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_rotate_interval_type = days {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] log_rotation_type = none {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] max_age = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] max_logfile_count = 30 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] max_logfile_size_mb = 200 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] max_over_subscription_ratio = 20.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] message_reap_interval = 86400 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] message_ttl = 2592000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] monkey_patch = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] monkey_patch_modules = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] my_ip = 192.168.122.159 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] no_snapshot_gb_quota = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] num_iser_scan_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] num_shell_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] num_volume_device_scan_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] nvmeof_conn_info_version = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] nvmet_ns_id = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] nvmet_port_id = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_max_limit = 1000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_ext_list = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_listen_port = 8776 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_use_ssl = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] osapi_volume_workers = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] per_volume_size_limit = -1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] periodic_fuzzy_delay = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] periodic_interval = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] public_endpoint = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] publish_errors = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_backup_gigabytes = 1000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_backups = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_gigabytes = 1000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_groups = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_snapshots = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] quota_volumes = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] rate_limit_burst = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] rate_limit_except_level = CRITICAL {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] rate_limit_interval = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] reinit_driver_count = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] replication_device = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] report_discard_supported = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] report_interval = 120 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] reservation_clean_interval = 86400 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] reservation_expire = 86400 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] reserved_image_namespaces = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] reserved_percentage = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] rpc_response_timeout = 120 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] run_external_periodic_tasks = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] scst_target_driver = iscsi {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] scst_target_iqn_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_down_time = 720 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] shell_completion = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] snapshot_name_template = snapshot-%s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] snapshot_same_host = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] split_loggers = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] state_path = /opt/stack/data/cinder {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] storage_availability_zone = nova {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] storage_protocol = iSCSI {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] syslog_log_facility = LOG_USER {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_helper = lioadm {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_ip_address = 192.168.122.159 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_port = 3260 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_protocol = iscsi {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] target_secondary_ip_addresses = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] trace_flags = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] transport_url = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] until_refresh = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_chap_auth = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_default_quota_class = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_journal = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_json = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_multipath_for_image_xfer = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_stderr = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] use_syslog = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] verify_glance_signatures = enabled {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_api_class = cinder.volume.api.API {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_backend_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_clear = zero {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_clear_ionice = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_clear_size = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_copy_bps_limit = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_dd_blocksize = 1M {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_name_template = volume-%s {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_service_inithost_offload = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volume_usage_audit_period = month {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] zoning_mode = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.admin_password = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.admin_token = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.admin_user = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_port = 35357 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_protocol = https {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_section = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_type = password {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_uri = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.auth_version = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.cache = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.identity_uri = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.interface = public {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_password = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcache_username = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.region_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.service_type = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.backend = dogpile.cache.null {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.backend_argument = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.backend_expiration_time = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.config_prefix = cache.oslo {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.debug_cache_backend = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.enable_retry_client = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.enable_socket_keepalive = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.enforce_fips_mode = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.expiration_time = 600 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_dead_retry = 300 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_pool_maxsize = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:30 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_sasl_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.password = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.proxies = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.redis_db = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.redis_server = localhost:6379 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.retry_attempts = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.retry_delay = 0.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.socket_keepalive_count = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.socket_keepalive_idle = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.socket_keepalive_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.socket_timeout = 1.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.tls_allowed_ciphers = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.tls_cafile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.tls_certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.tls_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.tls_keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cache.username = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] coordination.backend_url = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.asyncio_connection = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.asyncio_slave_connection = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.backend = sqlalchemy {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.connection = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.connection_debug = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.connection_parameters = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.connection_recycle_time = 3600 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.connection_trace = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.db_inc_retry_interval = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.db_max_retries = 20 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.db_max_retry_interval = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.db_retry_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.max_overflow = 50 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.max_pool_size = 5 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.max_retries = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.pool_timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.retry_interval = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.slave_connection = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.sqlite_synchronous = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.synchronous_reader = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] database.use_db_reconnect = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.connection_string = messaging:// {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.es_doc_type = notification {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.es_scroll_size = 10000 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.es_scroll_time = 2m {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.filter_error_trace = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.hmac_keys = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.sentinel_service_name = mymaster {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.socket_timeout = 0.1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.trace_requests = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler.trace_sqlalchemy = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler_jaeger.process_tags = {} {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] profiler_otlp.service_name_prefix = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.enforce_new_defaults = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: WARNING oslo_config.cfg [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.enforce_scope = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.policy_default_rule = default {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.policy_file = policy.yaml {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack sudo[73545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.group = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.helper_command = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] privsep_osbrick.user = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack sudo[73545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.group = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.helper_command = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] cinder_sys_admin.user = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.auth_section = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.auth_type = password {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.cafile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.collect_timing = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.send_service_user_token = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.split_loggers = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] service_user.timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.auth_section = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.auth_type = password {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.collect_timing = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.region_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.split_loggers = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] glance.timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.backend_availability_zone = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.chap_password = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.chap_username = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.disk_geometry = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_client_cert = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_data_namespace = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.driver_use_ssl = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.extra_capabilities = {} {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.filter_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.goodness_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iscsi_target_flags = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iser_helper = tgtadm {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iser_port = 3260 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.lvm_share_target = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.lvm_type = auto {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.replication_device = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.report_discard_supported = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_helper = tgtadm {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_port = 3260 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_protocol = iscsi {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.trace_flags = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.use_chap_auth = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_backend_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_clear = zero {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_reports.file_event_handler = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_reports.log_dir = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.backend_host = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.chap_password = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.chap_username = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.disk_geometry = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_client_cert = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.extra_capabilities = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.filter_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.goodness_function = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iser_helper = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iser_ip_address = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iser_port = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.lvm_share_target = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.lvm_type = auto {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.num_shell_tries = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.replication_device = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.report_discard_supported = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.reserved_percentage = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.scst_target_driver = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.storage_protocol = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_helper = lioadm {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_ip_address = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_port = 3260 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.trace_flags = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.use_chap_auth = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_clear = zero {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_clear_size = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] lvmdriver-1.volumes_dir = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_notifications.driver = [] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] key_manager.fixed_key = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.barbican_api_version = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.barbican_endpoint = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.barbican_endpoint_type = public {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.barbican_region_name = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.cafile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.collect_timing = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.number_of_retries = 60 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.retry_delay = 1 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.send_service_user_token = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.split_loggers = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.verify_ssl = True {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican.verify_ssl_path = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.auth_section = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.auth_type = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.cafile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.certfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.collect_timing = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.insecure = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.keyfile = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.split_loggers = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] barbican_service_user.timeout = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.approle_role_id = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.approle_secret_id = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.kv_mountpoint = secret {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.kv_path = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.kv_version = 2 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.namespace = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.root_token_id = **** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.ssl_ca_crt_file = None {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.timeout = 60.0 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.use_ssl = False {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:30 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] ******************************************************************************** {{(pid=73433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:00:31 devstack sudo[73545]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:31 devstack sudo[73566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:31 devstack sudo[73566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:31 devstack sudo[73566]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.538s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:00:31 devstack cinder-volume[73541]: INFO cinder.brick.local_dev.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:31 devstack sudo[73819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:31 devstack sudo[73819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:32 devstack sudo[73819]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:32 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:32 devstack cinder-volume[73541]: DEBUG cinder.brick.local_dev.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73541) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 07 06:00:32 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:32 devstack sudo[73986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:32 devstack sudo[73986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:33 devstack sudo[73986]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.176s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:33 devstack sudo[74186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:33 devstack sudo[74186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:33 devstack sudo[74186]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:33 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:33 devstack sudo[74237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 07 06:00:33 devstack sudo[74237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:34 devstack sudo[74237]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:34 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.453s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:34 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:34 devstack sudo[74240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:34 devstack sudo[74240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:34 devstack sudo[74240]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:34 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:34 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:34 devstack sudo[74251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:34 devstack sudo[74251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:35 devstack sudo[74251]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:35 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:35 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:35 devstack sudo[74258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:35 devstack sudo[74258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:35 devstack sudo[74258]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:35 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:35 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:35 devstack sudo[74263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:35 devstack sudo[74263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:36 devstack sudo[74263]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:36 devstack sudo[74267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:36 devstack sudo[74267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:36 devstack sudo[74267]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:36 devstack cinder-volume[73541]: INFO cinder.volume.drivers.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:36 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:36 devstack sudo[74280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:36 devstack sudo[74280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:37 devstack sudo[74280]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:37 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:37 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:37 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:37 devstack sudo[74396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:37 devstack sudo[74396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:37 devstack sudo[74396]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:37 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:37 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:37 devstack sudo[74446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:37 devstack sudo[74446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:38 devstack sudo[74446]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:38 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:38 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:38 devstack sudo[74537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:38 devstack sudo[74537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:38 devstack sudo[74537]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:38 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.490s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:38 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:38 devstack sudo[74541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:38 devstack sudo[74541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:39 devstack sudo[74541]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:39 devstack cinder-volume[73541]: INFO cinder.volume.driver [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG cinder.volume.driver [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73541) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG oslo_db.sqlalchemy.engines [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG dbcounter [-] [73541] Writer thread running {{(pid=73541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG cinder.db.sqlalchemy.api [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Building query based on filter {{(pid=73541) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG cinder.image.image_utils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73541) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:00:39 devstack cinder-volume[73541]: INFO cinder.keymgr.migration [None req-a9948e99-a22c-44ec-bfd2-29fe47932965 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:39 devstack sudo[74545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:39 devstack sudo[74545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:39 devstack sudo[74545]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:39 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:39 devstack sudo[74553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:39 devstack sudo[74553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:40 devstack sudo[74553]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:40 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:40 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:40 devstack sudo[74558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:40 devstack sudo[74558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:40 devstack cinder-volume[73433]: DEBUG dbcounter [-] [73433] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:00:40 devstack sudo[74558]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:40 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:40 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:40 devstack sudo[74563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:40 devstack sudo[74563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:41 devstack sudo[74563]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG cinder.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Notifying Schedulers of capabilities ... {{(pid=73541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:00:41 devstack cinder-volume[73541]: INFO cinder.volume.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Driver initialization completed successfully. Apr 07 06:00:41 devstack cinder-volume[73541]: INFO cinder.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Initiating service 2 cleanup Apr 07 06:00:41 devstack cinder-volume[73541]: INFO cinder.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Service 2 cleanup completed. Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG cinder.service [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Creating RPC server for service cinder-volume {{(pid=73541) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG cinder.service [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73541) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:00:41 devstack cinder-volume[73541]: INFO cinder.volume.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:41 devstack sudo[74567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:41 devstack sudo[74567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:41 devstack sudo[74567]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:41 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:41 devstack sudo[74574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:41 devstack sudo[74574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:42 devstack sudo[74574]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:42 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:42 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:42 devstack sudo[74577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:42 devstack sudo[74577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:42 devstack sudo[74577]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:42 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:42 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:42 devstack sudo[74634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:42 devstack sudo[74634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:43 devstack sudo[74634]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:43 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:43 devstack cinder-volume[73541]: INFO cinder.volume.manager [None req-57c76c06-e473-4557-bad1-2967aa5b43d8 None None] Driver post RPC initialization completed successfully. Apr 07 06:00:51 devstack cinder-volume[73541]: DEBUG dbcounter [-] [73541] Writing DB stats cinder:SELECT=3 {{(pid=73541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:00:53 devstack cinder-volume[73541]: DEBUG dbcounter [-] [73541] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:01:44 devstack cinder-volume[73541]: DEBUG oslo_service.periodic_task [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73541) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:01:44 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:01:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:01:44 devstack sudo[79400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:01:44 devstack sudo[79400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:01:44 devstack sudo[79400]: pam_unix(sudo:session): session closed for user root Apr 07 06:01:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:01:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:01:44 devstack sudo[79403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:01:44 devstack sudo[79403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:01:45 devstack sudo[79403]: pam_unix(sudo:session): session closed for user root Apr 07 06:01:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:01:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:01:45 devstack sudo[79406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:01:45 devstack sudo[79406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:01:45 devstack sudo[79406]: pam_unix(sudo:session): session closed for user root Apr 07 06:01:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:01:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:01:45 devstack sudo[79409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:01:45 devstack sudo[79409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:01:46 devstack sudo[79409]: pam_unix(sudo:session): session closed for user root Apr 07 06:01:46 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:01:46 devstack cinder-volume[73541]: DEBUG cinder.manager [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Notifying Schedulers of capabilities ... {{(pid=73541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:02:44 devstack cinder-volume[73541]: DEBUG oslo_service.periodic_task [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73541) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:02:44 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:02:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:44 devstack sudo[80033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:02:44 devstack sudo[80033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:44 devstack sudo[80033]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:44 devstack sudo[80047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:02:44 devstack sudo[80047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:45 devstack sudo[80047]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:45 devstack sudo[80069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:02:45 devstack sudo[80069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:45 devstack sudo[80069]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:45 devstack sudo[80172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:02:45 devstack sudo[80172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:46 devstack sudo[80172]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:46 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:46 devstack cinder-volume[73541]: DEBUG cinder.manager [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Notifying Schedulers of capabilities ... {{(pid=73541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:02:53 devstack cinder-volume[73541]: DEBUG dbcounter [-] [73541] Writing DB stats cinder:SELECT=1 {{(pid=73541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:02:53 devstack cinder-volume[73541]: DEBUG dbcounter [-] [73541] Writing DB stats cinder:UPDATE=1 {{(pid=73541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:03:44 devstack cinder-volume[73541]: DEBUG oslo_service.periodic_task [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73541) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:03:44 devstack cinder-volume[73541]: DEBUG cinder.volume.drivers.lvm [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Updating volume stats {{(pid=73541) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:03:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:44 devstack sudo[81944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:03:44 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:44 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:44 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:44 devstack sudo[81979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:03:44 devstack sudo[81979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:45 devstack sudo[81979]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:45 devstack sudo[82011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:03:45 devstack sudo[82011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:45 devstack sudo[82011]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:45 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:45 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:03:45 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:46 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:46 devstack cinder-volume[73541]: DEBUG oslo_concurrency.processutils [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73541) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:46 devstack cinder-volume[73541]: DEBUG cinder.manager [None req-bae4625c-e05d-4237-9bb3-5895cf0d247f None None] Notifying Schedulers of capabilities ... {{(pid=73541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:29 devstack cinder-volume[73433]: INFO oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Caught SIGTERM, stopping children Apr 07 06:04:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Acquiring lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Acquired lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:29 devstack cinder-volume[73433]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Releasing lock "singleton_lock" {{(pid=73433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:29 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Stop services. {{(pid=73433) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 07 06:04:29 devstack cinder-volume[73433]: DEBUG oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Killing children. {{(pid=73433) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 07 06:04:29 devstack cinder-volume[73433]: INFO oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Waiting on 1 children to exit Apr 07 06:04:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Acquiring lock "singleton_lock" {{(pid=73541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Acquired lock "singleton_lock" {{(pid=73541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:31 devstack cinder-volume[73541]: DEBUG oslo_concurrency.lockutils [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Releasing lock "singleton_lock" {{(pid=73541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:31 devstack cinder-volume[73541]: WARNING amqp [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:31 devstack cinder-volume[73541]: WARNING amqp [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:31 devstack cinder-volume[73433]: INFO oslo_service.backend._eventlet.service [None req-8c7eca73-aacd-4bc3-8dd6-21abda59f7a1 None None] Child 73541 exited with status 0 Apr 07 06:04:33 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:33 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:33 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:34 devstack cinder-volume[82840]: INFO dbcounter [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Registered counter for database cinder Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_db.sqlalchemy.engines [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG dbcounter [-] [82840] Writer thread running {{(pid=82840) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:34 devstack cinder-volume[82840]: INFO cinder.rpc [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:04:34 devstack cinder-volume[82840]: INFO cinder.rpc [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_db.sqlalchemy.engines [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:34 devstack cinder-volume[82840]: INFO cinder.volume.manager [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Determined volume DB was empty at startup. Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG cinder.volume.manager [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82840) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:04:34 devstack cinder-volume[82840]: INFO cinder.volume.manager [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 07 06:04:34 devstack cinder-volume[82840]: WARNING stevedore.named [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:04:34 devstack cinder-volume[82840]: WARNING castellan.key_manager [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:34 devstack cinder-volume[82840]: WARNING cinder.keymgr.conf_key_mgr [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:34 devstack cinder-volume[82840]: INFO cinder.volume.manager [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_db.sqlalchemy.engines [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:34 devstack cinder-volume[82840]: INFO oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Starting 1 workers Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Started child 82964 {{(pid=82840) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Full set of CONF: {{(pid=82840) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] ******************************************************************************** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Configuration options gathered from: {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] ================================================================================ {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] allow_availability_zone_fallback = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] allow_compression_on_image_upload = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] allowed_direct_url_schemes = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] api_rate_limit = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82964]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] auth_strategy = keystone {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_availability_zone = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_host = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_stats_polling_interval = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backup_api_class = cinder.backup.api.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backup_name_template = backup-%s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backup_use_same_host = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backup_use_temp_snapshot = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] chap_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] chap_username = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_internal_tenant_project_id = fc1e4f7c2260441087210b8159ec0941 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_internal_tenant_user_id = b232c2fb3f6a498ea96b5e0ff8347145 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cluster = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] compression_format = gzip {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] compute_api_class = cinder.compute.nova.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] config_dir = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] config_source = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] control_exchange = openstack {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] debug = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] default_availability_zone = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] default_group_type = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] default_volume_type = QuobyteHD {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] disk_geometry = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_client_cert = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_client_cert_key = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_data_namespace = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_ssl_cert_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_ssl_cert_verify = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] driver_use_ssl = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] enable_new_services = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] enable_unsupported_driver = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] enabled_backends = ['QuobyteHD'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] enforce_multipath_for_image_xfer = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] filter_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_api_insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_api_ssl_compression = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_ca_certificates_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_catalog_info = image:glance:publicURL {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_num_retries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance_request_timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] goodness_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] graceful_shutdown_timeout = 5 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] group_api_class = cinder.group.api.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] host = devstack {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_compress_on_upload = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_conversion_address_space_limit = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_conversion_cpu_limit = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_conversion_disable = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_upload_use_cinder_backend = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_upload_use_internal_tenant = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_volume_cache_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_volume_cache_max_count = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] image_volume_cache_max_size_gb = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] init_host_max_objects_retrieval = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] instance_format = [instance: %(uuid)s] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iscsi_target_flags = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iscsi_write_cache = on {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iser_helper = tgtadm {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iser_ip_address = 192.168.122.159 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iser_port = 3260 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_color = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_config_append = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_dir = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_options = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_rotate_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_rotate_interval_type = days {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] log_rotation_type = none {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] max_age = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] max_logfile_count = 30 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] max_logfile_size_mb = 200 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] max_over_subscription_ratio = 20.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] message_reap_interval = 86400 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] message_ttl = 2592000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] migration_create_volume_timeout_secs = 300 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] monkey_patch = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] monkey_patch_modules = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] my_ip = 192.168.122.159 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] no_snapshot_gb_quota = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] num_iser_scan_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] num_shell_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] num_volume_device_scan_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] nvmeof_conn_info_version = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] nvmet_ns_id = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] nvmet_port_id = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_max_limit = 1000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_ext_list = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_listen_port = 8776 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_use_ssl = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] osapi_volume_workers = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] per_volume_size_limit = -1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] periodic_fuzzy_delay = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] periodic_interval = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] public_endpoint = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] publish_errors = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_backup_gigabytes = 1000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_backups = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_gigabytes = 1000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_groups = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_snapshots = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] quota_volumes = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] rate_limit_burst = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] rate_limit_except_level = CRITICAL {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] rate_limit_interval = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] reinit_driver_count = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] replication_device = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] report_discard_supported = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] report_interval = 120 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] reservation_clean_interval = 86400 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] reservation_expire = 86400 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] reserved_image_namespaces = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] reserved_percentage = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] rpc_response_timeout = 120 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] run_external_periodic_tasks = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] scst_target_driver = iscsi {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] scst_target_iqn_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_down_time = 720 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] shell_completion = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] snapshot_name_template = snapshot-%s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] split_loggers = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] state_path = /opt/stack/data/cinder {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] storage_availability_zone = nova {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82964]: INFO cinder.volume.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] storage_protocol = iSCSI {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.remotefs [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82964) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] syslog_log_facility = LOG_USER {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_helper = lioadm {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_ip_address = 192.168.122.159 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_port = 3260 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_protocol = iscsi {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] target_secondary_ip_addresses = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] trace_flags = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] transport_url = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] until_refresh = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_chap_auth = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_default_quota_class = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_journal = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_json = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_multipath_for_image_xfer = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_stderr = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] use_syslog = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] verify_glance_signatures = enabled {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_api_class = cinder.volume.api.API {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_backend_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_clear = zero {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_clear_ionice = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_clear_size = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_copy_bps_limit = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_dd_blocksize = 1M {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_name_template = volume-%s {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_service_inithost_offload = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volume_usage_audit_period = month {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] zoning_mode = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_concurrency.disable_process_locking = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.admin_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.admin_token = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.admin_user = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_port = 35357 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_protocol = https {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_section = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_type = password {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_uri = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.auth_version = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.cache = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.identity_uri = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.include_service_catalog = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.interface = public {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_password = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcache_username = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.region_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.service_type = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.backend = dogpile.cache.null {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.backend_argument = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.backend_expiration_time = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.config_prefix = cache.oslo {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.debug_cache_backend = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.enable_retry_client = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.enable_socket_keepalive = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.enforce_fips_mode = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.expiration_time = 600 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:34 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.hashclient_retry_attempts = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_dead_retry = 300 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_pool_maxsize = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_sasl_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.proxies = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.redis_db = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.redis_server = localhost:6379 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.retry_attempts = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.retry_delay = 0.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.socket_keepalive_count = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.socket_keepalive_idle = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.socket_keepalive_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.socket_timeout = 1.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.tls_allowed_ciphers = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.tls_cafile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.tls_certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.tls_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.tls_keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cache.username = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] coordination.backend_url = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.asyncio_connection = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.asyncio_slave_connection = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.backend = sqlalchemy {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.connection = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.connection_debug = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.connection_parameters = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.connection_recycle_time = 3600 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.connection_trace = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.db_inc_retry_interval = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.db_max_retries = 20 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.db_max_retry_interval = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.db_retry_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.max_overflow = 50 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.max_pool_size = 5 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.max_retries = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.mysql_wsrep_sync_wait = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.pool_timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.retry_interval = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.slave_connection = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.sqlite_synchronous = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.synchronous_reader = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] database.use_db_reconnect = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.connection_string = messaging:// {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.es_doc_type = notification {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.es_scroll_size = 10000 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.es_scroll_time = 2m {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.filter_error_trace = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.hmac_keys = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.sentinel_service_name = mymaster {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.socket_timeout = 0.1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.trace_requests = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler.trace_sqlalchemy = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler_jaeger.process_tags = {} {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler_jaeger.service_name_prefix = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] profiler_otlp.service_name_prefix = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.enforce_new_defaults = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: WARNING oslo_config.cfg [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.enforce_scope = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.policy_default_rule = default {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.policy_file = policy.yaml {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.group = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.helper_command = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] privsep_osbrick.user = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.group = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.helper_command = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] cinder_sys_admin.user = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.auth_section = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.auth_type = password {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.cafile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.collect_timing = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.send_service_user_token = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.split_loggers = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] service_user.timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.auth_section = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.auth_type = password {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.collect_timing = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.region_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.split_loggers = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] glance.timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.backend_availability_zone = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.chap_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.chap_username = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.disk_geometry = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_client_cert = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_client_cert_key = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_data_namespace = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.driver_use_ssl = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.extra_capabilities = {} {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.filter_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.goodness_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iscsi_target_flags = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iscsi_write_cache = on {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iser_helper = tgtadm {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iser_port = 3260 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_host = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_login = admin {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_mount_options = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_private_key = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_share_path = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82964) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.num_shell_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82964]: WARNING cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82964]: WARNING cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.quobyte_volume_url = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.replication_device = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.report_discard_supported = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.reserved_percentage = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_helper = tgtadm {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_port = 3260 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_protocol = iscsi {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.trace_flags = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.unique_fqdn_network = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.use_chap_auth = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_backend_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_clear = zero {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_clear_ionice = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_clear_size = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_reports.file_event_handler = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_reports.log_dir = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.backend_availability_zone = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.backend_host = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.chap_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.chap_username = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.chiscsi_conf = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.disk_geometry = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_client_cert = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_data_namespace = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.driver_use_ssl = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.extra_capabilities = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.filter_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.goodness_function = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iser_helper = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iser_ip_address = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iser_port = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.iser_target_prefix = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_host = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_login = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_mount_options = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_password = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_private_key = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_share_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_ssh_port = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.num_shell_tries = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.nvmet_port_id = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.replication_device = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.report_discard_supported = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.reserved_percentage = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.scst_target_driver = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.storage_protocol = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_helper = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_ip_address = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_port = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_prefix = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_protocol = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.trace_flags = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.use_chap_auth = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_clear = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_clear_size = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] QuobyteHD.volumes_dir = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_notifications.driver = [] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_notifications.retry = -1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] key_manager.fixed_key = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.barbican_api_version = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.barbican_endpoint = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.barbican_endpoint_type = public {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.barbican_region_name = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.cafile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.collect_timing = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.number_of_retries = 60 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.retry_delay = 1 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.send_service_user_token = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.split_loggers = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.verify_ssl = True {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican.verify_ssl_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.auth_section = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.auth_type = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.cafile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.certfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.collect_timing = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.insecure = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.keyfile = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.split_loggers = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] barbican_service_user.timeout = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.approle_role_id = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.approle_secret_id = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.kv_mountpoint = secret {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.kv_path = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.kv_version = 2 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.namespace = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.root_token_id = **** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.ssl_ca_crt_file = None {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.timeout = 60.0 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.use_ssl = False {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:35 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] ******************************************************************************** {{(pid=82840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:04:35 devstack quobyte-client[82965]: Reading configuration file: /etc/quobyte/client.cfg Apr 07 06:04:35 devstack quobyte-client[82965]: Invalid parameters found, error: missing mount point. Apr 07 06:04:35 devstack quobyte-client[82965]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 07 06:04:35 devstack quobyte-client[82965]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=82964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:35 devstack cinder-volume[82964]: INFO cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 ... Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 -c /etc/quobyte/client-cinder.cfg {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:35 devstack sudo[82966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 -c /etc/quobyte/client-cinder.cfg Apr 07 06:04:35 devstack sudo[82966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:35 devstack sudo[82966]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.611s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:35 devstack cinder-volume[82964]: INFO cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 succeeded Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=82964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.620s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:35 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:35 devstack sudo[83035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:35 devstack sudo[83035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:36 devstack sudo[83035]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.476s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.volume.driver [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.volume.driver [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7451705932617, 'free_capacity_gb': 1775.7451705932617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82964) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_db.sqlalchemy.engines [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG dbcounter [-] [82964] Writer thread running {{(pid=82964) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.db.sqlalchemy.api [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Building query based on filter {{(pid=82964) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.image.image_utils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82964) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.keymgr.migration [None req-8df4734b-840f-4ab8-a0c5-81adc1743fca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=82964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=82964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:36 devstack sudo[83038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:36 devstack sudo[83038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:36 devstack sudo[83038]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.470s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Notifying Schedulers of capabilities ... {{(pid=82964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.volume.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Driver initialization completed successfully. Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Initiating service 3 cleanup Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Service 3 cleanup completed. Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.service [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Creating RPC server for service cinder-volume {{(pid=82964) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.service [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82964) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:04:36 devstack cinder-volume[82964]: INFO cinder.volume.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=82964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=82964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:36 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:36 devstack sudo[83045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:36 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:37 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:37 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.504s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:37 devstack cinder-volume[82964]: INFO cinder.volume.manager [None req-4120a21e-3a73-48b4-bad4-d875943b85e2 None None] Driver post RPC initialization completed successfully. Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=82964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG cinder.volume.drivers.quobyte [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=82964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82964) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:40 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:40 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:40 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG oslo_concurrency.processutils [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.446s {{(pid=82964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:40 devstack cinder-volume[82964]: DEBUG cinder.manager [None req-f849f0d7-e553-4ede-982b-96741f962b65 None None] Notifying Schedulers of capabilities ... {{(pid=82964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:42 devstack cinder-volume[82840]: INFO oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Caught SIGTERM, stopping children Apr 07 06:04:42 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Acquiring lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:42 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Acquired lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:42 devstack cinder-volume[82840]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Releasing lock "singleton_lock" {{(pid=82840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:42 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Stop services. {{(pid=82840) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 07 06:04:42 devstack cinder-volume[82840]: DEBUG oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Killing children. {{(pid=82840) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 07 06:04:42 devstack cinder-volume[82840]: INFO oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Waiting on 1 children to exit Apr 07 06:04:45 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Acquiring lock "singleton_lock" {{(pid=82964) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:45 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Acquired lock "singleton_lock" {{(pid=82964) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:45 devstack cinder-volume[82964]: DEBUG oslo_concurrency.lockutils [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Releasing lock "singleton_lock" {{(pid=82964) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:45 devstack cinder-volume[82964]: WARNING amqp [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:45 devstack cinder-volume[82964]: WARNING amqp [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:45 devstack cinder-volume[82840]: INFO oslo_service.backend._eventlet.service [None req-663debec-236b-4559-a6bc-7895fd71fb68 None None] Child 82964 exited with status 0 Apr 07 06:04:48 devstack cinder-volume[83222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:48 devstack cinder-volume[83222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:48 devstack cinder-volume[83222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:49 devstack cinder-volume[83222]: INFO dbcounter [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Registered counter for database cinder Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_db.sqlalchemy.engines [None req-dca117cc-5632-49e2-a644-44be763243fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG dbcounter [-] [83222] Writer thread running {{(pid=83222) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:49 devstack cinder-volume[83222]: INFO cinder.rpc [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:04:49 devstack cinder-volume[83222]: INFO cinder.rpc [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_db.sqlalchemy.engines [None req-dca117cc-5632-49e2-a644-44be763243fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:49 devstack cinder-volume[83222]: INFO cinder.volume.manager [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Determined volume DB was empty at startup. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG cinder.volume.manager [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83222) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:04:49 devstack cinder-volume[83222]: WARNING stevedore.named [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:04:49 devstack cinder-volume[83222]: WARNING castellan.key_manager [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:49 devstack cinder-volume[83222]: WARNING cinder.keymgr.conf_key_mgr [None req-dca117cc-5632-49e2-a644-44be763243fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:49 devstack cinder-volume[83222]: INFO cinder.volume.manager [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_db.sqlalchemy.engines [None req-dca117cc-5632-49e2-a644-44be763243fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:49 devstack cinder-volume[83222]: INFO oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Starting 1 workers Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Started child 83450 {{(pid=83222) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Full set of CONF: {{(pid=83222) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] ******************************************************************************** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Configuration options gathered from: {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] ================================================================================ {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:04:49 devstack cinder-volume[83450]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] allow_availability_zone_fallback = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] allow_compression_on_image_upload = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] allowed_direct_url_schemes = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] api_rate_limit = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] auth_strategy = keystone {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_availability_zone = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_host = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_stats_polling_interval = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backup_api_class = cinder.backup.api.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backup_name_template = backup-%s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backup_use_same_host = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backup_use_temp_snapshot = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] chap_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] chap_username = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_internal_tenant_project_id = fc1e4f7c2260441087210b8159ec0941 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_internal_tenant_user_id = b232c2fb3f6a498ea96b5e0ff8347145 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cluster = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] compression_format = gzip {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] compute_api_class = cinder.compute.nova.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] config_dir = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] config_source = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] control_exchange = openstack {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] debug = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] default_availability_zone = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] default_group_type = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] default_volume_type = QuobyteHD {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] disk_geometry = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_client_cert = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_client_cert_key = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_data_namespace = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_ssl_cert_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_ssl_cert_verify = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] driver_use_ssl = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] enable_new_services = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] enable_unsupported_driver = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] enabled_backends = ['QuobyteHD'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] enforce_multipath_for_image_xfer = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] filter_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_api_insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_api_ssl_compression = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_ca_certificates_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_catalog_info = image:glance:publicURL {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_num_retries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance_request_timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] goodness_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] graceful_shutdown_timeout = 5 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] group_api_class = cinder.group.api.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] host = devstack {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_compress_on_upload = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_conversion_address_space_limit = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_conversion_cpu_limit = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_conversion_disable = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_upload_use_cinder_backend = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_upload_use_internal_tenant = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_volume_cache_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_volume_cache_max_count = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] image_volume_cache_max_size_gb = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] init_host_max_objects_retrieval = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] instance_format = [instance: %(uuid)s] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iscsi_target_flags = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iscsi_write_cache = on {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iser_helper = tgtadm {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iser_ip_address = 192.168.122.159 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iser_port = 3260 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_color = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_config_append = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_dir = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_options = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_rotate_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_rotate_interval_type = days {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] log_rotation_type = none {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83450) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] max_age = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] max_logfile_count = 30 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] max_logfile_size_mb = 200 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] max_over_subscription_ratio = 20.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] message_reap_interval = 86400 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] message_ttl = 2592000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] migration_create_volume_timeout_secs = 300 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] monkey_patch = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] monkey_patch_modules = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] my_ip = 192.168.122.159 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] no_snapshot_gb_quota = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] num_iser_scan_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] num_shell_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] num_volume_device_scan_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] nvmeof_conn_info_version = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] nvmet_ns_id = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] nvmet_port_id = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_max_limit = 1000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_ext_list = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_listen_port = 8776 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_use_ssl = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] osapi_volume_workers = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] per_volume_size_limit = -1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] periodic_fuzzy_delay = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] periodic_interval = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] public_endpoint = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] publish_errors = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_backup_gigabytes = 1000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_backups = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_gigabytes = 1000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_groups = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_snapshots = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] quota_volumes = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] rate_limit_burst = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] rate_limit_except_level = CRITICAL {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] rate_limit_interval = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] reinit_driver_count = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] replication_device = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] report_discard_supported = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] report_interval = 120 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] reservation_clean_interval = 86400 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] reservation_expire = 86400 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] reserved_image_namespaces = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] reserved_percentage = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] rpc_response_timeout = 120 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] run_external_periodic_tasks = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] scst_target_driver = iscsi {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] scst_target_iqn_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_down_time = 720 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] shell_completion = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] snapshot_name_template = snapshot-%s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] split_loggers = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] state_path = /opt/stack/data/cinder {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] storage_availability_zone = nova {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] storage_protocol = iSCSI {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] syslog_log_facility = LOG_USER {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_helper = lioadm {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_ip_address = 192.168.122.159 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_port = 3260 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_protocol = iscsi {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] target_secondary_ip_addresses = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] trace_flags = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] transport_url = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] until_refresh = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_chap_auth = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_default_quota_class = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_journal = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_json = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_multipath_for_image_xfer = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_stderr = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] use_syslog = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] verify_glance_signatures = enabled {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_api_class = cinder.volume.api.API {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_backend_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_clear = zero {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_clear_ionice = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_clear_size = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_copy_bps_limit = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_dd_blocksize = 1M {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_name_template = volume-%s {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_service_inithost_offload = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volume_usage_audit_period = month {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] zoning_mode = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_concurrency.disable_process_locking = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.admin_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.admin_token = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.admin_user = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_admin_prefix = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_port = 35357 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_protocol = https {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_section = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_type = password {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_uri = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.auth_version = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.cache = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.identity_uri = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.include_service_catalog = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.interface = public {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_password = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcache_username = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.region_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.service_token_roles_required = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.service_type = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.backend = dogpile.cache.null {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.backend_argument = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.backend_expiration_time = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.config_prefix = cache.oslo {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.debug_cache_backend = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.enable_retry_client = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.enable_socket_keepalive = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.enforce_fips_mode = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.expiration_time = 600 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.hashclient_retry_attempts = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_dead_retry = 300 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_pool_maxsize = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_sasl_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.proxies = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.redis_db = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.redis_server = localhost:6379 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.retry_attempts = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.retry_delay = 0.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.socket_keepalive_count = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.socket_keepalive_idle = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.socket_keepalive_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.socket_timeout = 1.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.tls_allowed_ciphers = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.tls_cafile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83450) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.tls_certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.tls_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.tls_keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cache.username = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] coordination.backend_url = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.asyncio_connection = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.asyncio_slave_connection = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Running cmd (subprocess): mount.quobyte {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.backend = sqlalchemy {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.connection = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.connection_debug = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.connection_parameters = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.connection_recycle_time = 3600 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.connection_trace = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.db_inc_retry_interval = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.db_max_retries = 20 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.db_max_retry_interval = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.db_retry_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.max_overflow = 50 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.max_pool_size = 5 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.max_retries = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.mysql_wsrep_sync_wait = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.pool_timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.retry_interval = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.slave_connection = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.sqlite_synchronous = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.synchronous_reader = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] database.use_db_reconnect = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.connection_string = messaging:// {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.es_doc_type = notification {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.es_scroll_size = 10000 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.es_scroll_time = 2m {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.filter_error_trace = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.hmac_keys = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.sentinel_service_name = mymaster {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.socket_timeout = 0.1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.trace_requests = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler.trace_sqlalchemy = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler_jaeger.process_tags = {} {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler_jaeger.service_name_prefix = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] profiler_otlp.service_name_prefix = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.enforce_new_defaults = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: WARNING oslo_config.cfg [None req-dca117cc-5632-49e2-a644-44be763243fb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.enforce_scope = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.policy_default_rule = default {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.policy_file = policy.yaml {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.group = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.helper_command = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] privsep_osbrick.user = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.group = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.helper_command = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] cinder_sys_admin.user = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.auth_section = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.auth_type = password {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.cafile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.collect_timing = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.send_service_user_token = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.split_loggers = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] service_user.timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.auth_section = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.auth_type = password {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.collect_timing = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.region_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.split_loggers = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] glance.timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.backend_availability_zone = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.chap_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.chap_username = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.disk_geometry = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_client_cert = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_client_cert_key = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_data_namespace = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.driver_use_ssl = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.extra_capabilities = {} {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.filter_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.goodness_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iscsi_target_flags = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iscsi_write_cache = on {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iser_helper = tgtadm {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iser_port = 3260 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_host = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_login = admin {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_mount_options = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_private_key = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_share_path = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_ssh_port = 22 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.num_shell_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_client_cfg = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.quobyte_volume_url = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.replication_device = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.report_discard_supported = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.reserved_percentage = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_helper = tgtadm {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_port = 3260 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_protocol = iscsi {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.trace_flags = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.unique_fqdn_network = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.use_chap_auth = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_backend_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_clear = zero {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_clear_ionice = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_clear_size = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_reports.file_event_handler = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_reports.log_dir = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.backend_availability_zone = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.backend_host = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.chap_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.chap_username = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.chiscsi_conf = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.disk_geometry = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_client_cert = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_client_cert_key = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_data_namespace = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.driver_use_ssl = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.extra_capabilities = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.filter_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.goodness_function = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iscsi_target_flags = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iscsi_write_cache = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iser_helper = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iser_ip_address = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iser_port = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.iser_target_prefix = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack quobyte-client[83451]: Reading configuration file: /etc/quobyte/client.cfg Apr 07 06:04:49 devstack quobyte-client[83451]: Invalid parameters found, error: missing mount point. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_host = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_login = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_mount_options = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack quobyte-client[83451]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_password = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_private_key = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack quobyte-client[83451]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_share_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_ssh_port = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.num_shell_tries = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nvmet_ns_id = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.nvmet_port_id = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.replication_device = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.report_discard_supported = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.reserved_percentage = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.scst_target_driver = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.storage_protocol = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_helper = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_ip_address = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_port = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_prefix = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_protocol = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.trace_flags = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.unique_fqdn_network = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.use_chap_auth = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_clear = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_clear_ionice = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_clear_size = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] QuobyteHD.volumes_dir = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_notifications.driver = [] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_notifications.retry = -1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] key_manager.fixed_key = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.barbican_api_version = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.barbican_endpoint = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.barbican_endpoint_type = public {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.barbican_region_name = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.cafile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.collect_timing = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.number_of_retries = 60 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.retry_delay = 1 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.send_service_user_token = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.split_loggers = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.verify_ssl = True {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican.verify_ssl_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.auth_section = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.auth_type = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.cafile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.certfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.collect_timing = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.insecure = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.keyfile = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.split_loggers = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] barbican_service_user.timeout = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.approle_role_id = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.approle_secret_id = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.kv_mountpoint = secret {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.kv_path = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.kv_version = 2 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.namespace = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.root_token_id = **** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.ssl_ca_crt_file = None {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.timeout = 60.0 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.use_ssl = False {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:49 devstack cinder-volume[83222]: DEBUG oslo_service.backend._eventlet.service [None req-dca117cc-5632-49e2-a644-44be763243fb None None] ******************************************************************************** {{(pid=83222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:04:49 devstack sudo[83452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:49 devstack sudo[83452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:49 devstack sudo[83452]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.454s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:49 devstack cinder-volume[83450]: INFO cinder.volume.driver [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:04:49 devstack cinder-volume[83450]: DEBUG cinder.volume.driver [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7451705932617, 'free_capacity_gb': 1775.7451705932617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83450) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_db.sqlalchemy.engines [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writer thread running {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.db.sqlalchemy.api [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Building query based on filter {{(pid=83450) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83450) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:50 devstack cinder-volume[83450]: INFO cinder.keymgr.migration [None req-bd96eb2e-1970-4fb4-82ac-0c92514fdd7c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:04:50 devstack sudo[83463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:50 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:50 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.598s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Driver initialization completed successfully. Apr 07 06:04:50 devstack cinder-volume[83450]: INFO cinder.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Initiating service 3 cleanup Apr 07 06:04:50 devstack cinder-volume[83450]: INFO cinder.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Service 3 cleanup completed. Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.service [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Creating RPC server for service cinder-volume {{(pid=83450) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.service [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83450) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:04:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:50 devstack sudo[83469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:04:50 devstack sudo[83469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:51 devstack sudo[83469]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.540s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a17aff41-26ef-4602-887c-5f96dce099a2 None None] Driver post RPC initialization completed successfully. Apr 07 06:04:59 devstack cinder-volume[83222]: DEBUG dbcounter [-] [83222] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83222) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:05:00 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=3 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:05:01 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:05:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fb233748-efea-404a-849d-001d14e64839 tempest-BackendsCapabilitiesAdminTestsJSON-816262694 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7451705932617, 'free_capacity_gb': 1775.7451705932617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83450) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 07 06:05:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4f732f11-7441-4e8a-9a47-f9f37f0c9101 tempest-BackendsCapabilitiesAdminTestsJSON-816262694 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7451705932617, 'free_capacity_gb': 1775.7451705932617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83450) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 07 06:05:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-532cffd2-1d81-45b0-bd2b-c46439fb9991 tempest-GroupSnapshotsV319Test-1489256989 None] Group tempest-GroupSnapshotsV319Test-Group-1589580280: creating Apr 07 06:05:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-532cffd2-1d81-45b0-bd2b-c46439fb9991 tempest-GroupSnapshotsV319Test-1489256989 None] Group tempest-GroupSnapshotsV319Test-Group-1589580280: created successfully Apr 07 06:05:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-532cffd2-1d81-45b0-bd2b-c46439fb9991 tempest-GroupSnapshotsV319Test-1489256989 None] Create group completed successfully. Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Flow 'volume_create_manager' (ef21ee0e-4317-4bc6-8cd7-33388656613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd958587-6652-4769-b153-670987d7090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd958587-6652-4769-b153-670987d7090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006121989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a45d81ab-e593-41b4-8981-7ac5c72772c6,host='devstack@QuobyteHD#QuobyteHD',id=3ad46cf0-b3d7-4cac-889e-96713e57a8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae9348ae694799af52eda02c108e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:05:50Z,use_quota=True,user_id='8db3812ba8094fb2a5ca2577fc5c16ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492e1416-7d96-477b-8f53-b9a8ea1bfe64),volume_type_id=492e1416-7d96-477b-8f53-b9a8ea1bfe64)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f444d080-a9a1-45f6-9ef0-e1819e4ce83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f444d080-a9a1-45f6-9ef0-e1819e4ce83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ba0af-e20c-49cc-8ce8-d16240d877e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ba0af-e20c-49cc-8ce8-d16240d877e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad46cf0-b3d7-4cac-889e-96713e57a8c4', 'volume_name': 'volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ad3807-01ea-44a5-b6a9-7801cf58c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ad3807-01ea-44a5-b6a9-7801cf58c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ca67f-7510-4d18-9afb-02a506b56c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Volume 3ad46cf0-b3d7-4cac-889e-96713e57a8c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4', 'volume_size': 1} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a45d81ab-e593-41b4-8981-7ac5c72772c6,created_at=2026-04-07T04:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006121989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a45d81ab-e593-41b4-8981-7ac5c72772c6,host='devstack@QuobyteHD#QuobyteHD',id=3ad46cf0-b3d7-4cac-889e-96713e57a8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae9348ae694799af52eda02c108e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:05:50Z,use_quota=True,user_id='8db3812ba8094fb2a5ca2577fc5c16ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492e1416-7d96-477b-8f53-b9a8ea1bfe64),volume_type_id=492e1416-7d96-477b-8f53-b9a8ea1bfe64)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Creating volume 3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:05:50 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:50 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 1073741824 Apr 07 06:05:50 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:50 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 1073741824" returned: 0 in 0.894s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:51 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 Apr 07 06:05:51 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:51 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" returned: 0 in 0.802s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ca67f-7510-4d18-9afb-02a506b56c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1101b22-3c77-479a-8198-241ea8a394d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:05:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Volume volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 (3ad46cf0-b3d7-4cac-889e-96713e57a8c4): created successfully Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1101b22-3c77-479a-8198-241ea8a394d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:05:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Flow 'volume_create_manager' (ef21ee0e-4317-4bc6-8cd7-33388656613c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:05:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-10474e11-64b4-4a85-b783-71a2c079ffe0 tempest-GroupSnapshotsV319Test-1489256989 None] Created volume successfully. Apr 07 06:05:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] GroupSnapshot b00ed170-4fad-4a07-9305-ac705265b2da: creating. Apr 07 06:05:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Group snapshot b00ed170-4fad-4a07-9305-ac705265b2da: creating. {{(pid=83450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:05:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:05:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:05:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Creating offline snapshot b7683d19-333a-44af-8653-6142dfd576d4 of volume 3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:05:52 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg5chlowb/privsep.sock'] Apr 07 06:05:52 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg5chlowb/privsep.sock Apr 07 06:05:52 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:54 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:54 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Spawned new privsep daemon via rootwrap Apr 07 06:05:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Accepted privsep connection to /tmp/tmpg5chlowb/privsep.sock {{(pid=83450) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 07 06:05:54 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 07 06:05:54 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 07 06:05:54 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 07 06:05:54 devstack cinder-volume[83450]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84091 Apr 07 06:05:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9077d12-dd8c-4873-af8d-e91726bfb01e]: (2,) {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:05:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39e502-03ee-4b1e-92bd-585cefc3828b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:05:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:54 devstack sudo[84097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 Apr 07 06:05:54 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:55 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" returned: 0 in 0.896s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:55 devstack sudo[84117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 1G Apr 07 06:05:55 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:56 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 1G" returned: 0 in 0.891s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:56 devstack sudo[84123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 Apr 07 06:05:56 devstack sudo[84123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:56 devstack sudo[84123]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4" returned: 0 in 0.586s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:56 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:05:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:56 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 Apr 07 06:05:56 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:57 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4" returned: 0 in 0.764s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:57 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info Apr 07 06:05:57 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:58 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info" returned: 0 in 0.906s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:58 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:05:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:58 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info Apr 07 06:05:58 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:59 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.info" returned: 0 in 0.774s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.757s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:05:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-64369d92-12c2-48d6-9a87-0c3af2d157bc tempest-GroupSnapshotsV319Test-1489256989 None] group_snapshot b00ed170-4fad-4a07-9305-ac705265b2da: created successfully Apr 07 06:06:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] group_snapshot b00ed170-4fad-4a07-9305-ac705265b2da: deleting Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] group_snapshot b00ed170-4fad-4a07-9305-ac705265b2da: deleting {{(pid=83450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "cinder-quobyte-b7683d19-333a-44af-8653-6142dfd576d4" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-b7683d19-333a-44af-8653-6142dfd576d4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Deleting offline snapshot b7683d19-333a-44af-8653-6142dfd576d4 of volume 3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] snapshot_file for this snap is: volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4105a-6895-4f7a-9d5e-ccadf4b0c346]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:00 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 Apr 07 06:06:00 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Flow 'volume_create_manager' (304ec580-9728-4fe7-81f7-2ae2d1b66312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3858a982-b83c-46af-9b1a-fa19a9542426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3858a982-b83c-46af-9b1a-fa19a9542426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-587736899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829cb216-7abb-4ea7-8abf-e5adf420dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d73b90ecdd4eecb956b21a81fdda45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:01Z,use_quota=True,user_id='3f217ba0adfc4add91258c56735baca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33770765-04b5-4c9b-8a02-b97473f9bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33770765-04b5-4c9b-8a02-b97473f9bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f24343f-0845-483f-b0c3-4194e39d0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f24343f-0845-483f-b0c3-4194e39d0607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829cb216-7abb-4ea7-8abf-e5adf420dd38', 'volume_name': 'volume-829cb216-7abb-4ea7-8abf-e5adf420dd38', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb11445f-2d78-4fa6-81a4-9c1ab95e79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb11445f-2d78-4fa6-81a4-9c1ab95e79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f04871-9ed1-48ab-9346-31c9d9b56130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:01 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Volume 829cb216-7abb-4ea7-8abf-e5adf420dd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829cb216-7abb-4ea7-8abf-e5adf420dd38', 'volume_size': 1} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-587736899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829cb216-7abb-4ea7-8abf-e5adf420dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d73b90ecdd4eecb956b21a81fdda45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:01Z,use_quota=True,user_id='3f217ba0adfc4add91258c56735baca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Creating volume 829cb216-7abb-4ea7-8abf-e5adf420dd38 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:01 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:06:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:01 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 1073741824 Apr 07 06:06:01 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:02 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4" returned: 0 in 1.588s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47464d-ecb3-41b8-9f8d-0a1aa9701585]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:02 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 1073741824" returned: 0 in 0.917s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:02 devstack sudo[84207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 Apr 07 06:06:02 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:02 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 Apr 07 06:06:02 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:03 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38" returned: 0 in 0.719s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:03 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f04871-9ed1-48ab-9346-31c9d9b56130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829cb216-7abb-4ea7-8abf-e5adf420dd38', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f9bbcc-bd4c-49f4-8419-fd9eee72fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" returned: 0 in 0.858s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:03 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Volume volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 (829cb216-7abb-4ea7-8abf-e5adf420dd38): created successfully Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f9bbcc-bd4c-49f4-8419-fd9eee72fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Flow 'volume_create_manager' (304ec580-9728-4fe7-81f7-2ae2d1b66312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:03 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 Apr 07 06:06:03 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a400d0a4-1a2c-4bf3-95cf-2782ec7e8795 tempest-DeleteServersTestJSON-1578197769 None] Created volume successfully. Apr 07 06:06:03 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4" returned: 0 in 0.669s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:03 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4 Apr 07 06:06:03 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:04 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4.b7683d19-333a-44af-8653-6142dfd576d4" returned: 0 in 0.839s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-b7683d19-333a-44af-8653-6142dfd576d4" released by "_delete_snapshot" :: held 4.044s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" released by "delete_snapshot" :: held 4.084s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:04 devstack cinder-volume[83450]: WARNING cinder.quota [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-148457370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-148457370, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:04 devstack cinder-volume[83450]: WARNING cinder.quota [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-148457370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-148457370, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] Created reservations ['10aee279-3eda-4de9-b6c3-7129d3c9dbad', '1c69e2a4-1734-4ad0-bb7a-ba75ba62e351', '3c6ab6de-80a4-458f-87ed-43a654cfd091', '2d75e96a-4a9c-42a7-9d18-523a236c78f2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-358fb7e5-2c2c-40c8-9c9d-7c6d34803980 tempest-GroupSnapshotsV319Test-1489256989 None] group_snapshot b00ed170-4fad-4a07-9305-ac705265b2da: deleted successfully Apr 07 06:06:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" acquired by "delete_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a10a19-966a-4a96-ad4a-b4a917e22ee2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:05 devstack sudo[84233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 Apr 07 06:06:05 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:06 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" returned: 0 in 0.842s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:06 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4 Apr 07 06:06:06 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:07 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" returned: 0 in 1.087s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "cinder-quobyte-3ad46cf0-b3d7-4cac-889e-96713e57a8c4" released by "delete_volume" :: held 1.981s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Created reservations ['dbdf4c2a-7193-45fb-aaec-b382ad66c2b8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:07 devstack cinder-volume[83450]: WARNING cinder.quota [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-148457370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-148457370, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Created reservations ['618c0ec7-1267-471d-a4d6-ffbba5bb4162', 'cfaeedff-3f0c-4489-ada3-edb0f2245326', '255ddb18-c01a-4889-9135-78d1a03c9351', 'ebde976d-e8a8-47e5-ac44-b97dc2c5afa2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:07 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:07 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:08 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.893s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:08 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5a9da11d-7f40-4224-ac65-b3be5774acb9 tempest-GroupSnapshotsV319Test-1489256989 None] Delete group completed successfully. Apr 07 06:06:12 devstack cinder-volume[83450]: WARNING py.warnings [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 07 06:06:12 devstack cinder-volume[83450]: .first() Apr 07 06:06:12 devstack cinder-volume[83450]: Apr 07 06:06:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:12 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[390aaabe-9941-43d9-9ed5-f5b129816c7a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:13 devstack sudo[84277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 Apr 07 06:06:13 devstack sudo[84277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Flow 'volume_create_manager' (ded45a8c-fe85-4586-aeca-c6916c50ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87f9938-5f0e-4834-a39e-c75606d582a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87f9938-5f0e-4834-a39e-c75606d582a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1845543222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ef3504-89f8-4a31-b066-ac9892bd29e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30c04c842134a03a367c7ec1ff1e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:13Z,use_quota=True,user_id='27d45f15a5a244c0b11517a28e81b75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aef47cf-d450-4587-b204-5f6a27604335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aef47cf-d450-4587-b204-5f6a27604335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b58d083-967d-4ee1-a614-904cf48d7814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b58d083-967d-4ee1-a614-904cf48d7814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ef3504-89f8-4a31-b066-ac9892bd29e9', 'volume_name': 'volume-82ef3504-89f8-4a31-b066-ac9892bd29e9', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9574c-de87-4f70-b8c4-7edbf50f4e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9574c-de87-4f70-b8c4-7edbf50f4e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdac5e7-21c8-404c-8599-74d648811b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:13 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Volume 82ef3504-89f8-4a31-b066-ac9892bd29e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ef3504-89f8-4a31-b066-ac9892bd29e9', 'volume_size': 1} Apr 07 06:06:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:14 devstack sudo[84277]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38" returned: 0 in 1.782s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.809s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1845543222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ef3504-89f8-4a31-b066-ac9892bd29e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30c04c842134a03a367c7ec1ff1e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:13Z,use_quota=True,user_id='27d45f15a5a244c0b11517a28e81b75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Creating volume 82ef3504-89f8-4a31-b066-ac9892bd29e9 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:14 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 1073741824 Apr 07 06:06:14 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9', 'name': 'volume-829cb216-7abb-4ea7-8abf-e5adf420dd38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6880b83-96db-43f7-922c-c56897b81110', 'enforce_multipath': True} {{(pid=83450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:06:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-6d5f8f78-75ac-4571-be41-5952cd191040 req-bf12e2b3-c5df-49dd-8050-e16ffce7780b tempest-DeleteServersTestJSON-1578197769 None] attachment_update completed successfully. Apr 07 06:06:16 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 1073741824" returned: 0 in 2.247s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:16 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 Apr 07 06:06:16 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d5c5b373-2c23-4c59-92a2-9d983f6f96eb tempest-GroupsV314Test-1426359515 None] Group tempest-GroupsV314Test-Group-1581128836: creating Apr 07 06:06:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d5c5b373-2c23-4c59-92a2-9d983f6f96eb tempest-GroupsV314Test-1426359515 None] Group tempest-GroupsV314Test-Group-1581128836: created successfully Apr 07 06:06:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d5c5b373-2c23-4c59-92a2-9d983f6f96eb tempest-GroupsV314Test-1426359515 None] Create group completed successfully. Apr 07 06:06:17 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9" returned: 0 in 0.690s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] <== create_volume: return (3028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.038s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdac5e7-21c8-404c-8599-74d648811b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ef3504-89f8-4a31-b066-ac9892bd29e9', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af70a87-f5f3-40df-86cb-efcb889c0e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Volume volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 (82ef3504-89f8-4a31-b066-ac9892bd29e9): created successfully Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af70a87-f5f3-40df-86cb-efcb889c0e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Flow 'volume_create_manager' (ded45a8c-fe85-4586-aeca-c6916c50ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-69f1a630-3412-49c6-a174-228f6f46b1fb tempest-VolumesAdminNegativeTest-655018964 None] Created volume successfully. Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Flow 'volume_create_manager' (7b352994-2a3a-4477-b073-8a2bd31f5b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0230fede-a102-429b-a5db-80293a231d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0230fede-a102-429b-a5db-80293a231d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634674798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92fc20b6-1522-47ca-8b49-093e6fe728b5,host='devstack@QuobyteHD#QuobyteHD',id=0cd9e12a-b00d-446b-adcb-2eaaef893840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7cacf7fc284a2f85d6b8e66fef0325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:19Z,use_quota=True,user_id='9b72c5a045894734b4f54192f70ca8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7b5b886-79f4-418c-8b0d-0a06f9d25d15),volume_type_id=a7b5b886-79f4-418c-8b0d-0a06f9d25d15)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fb7aec-a242-4327-894d-164e1168343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fb7aec-a242-4327-894d-164e1168343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a0fbd4-c03b-4f5a-95e4-8f226b72a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a0fbd4-c03b-4f5a-95e4-8f226b72a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd9e12a-b00d-446b-adcb-2eaaef893840', 'volume_name': 'volume-0cd9e12a-b00d-446b-adcb-2eaaef893840', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22996d57-dc26-462d-8d57-5851b58899f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22996d57-dc26-462d-8d57-5851b58899f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452dd7eb-7fb4-4ab5-96a1-dcf6733703fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:19 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Volume 0cd9e12a-b00d-446b-adcb-2eaaef893840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd9e12a-b00d-446b-adcb-2eaaef893840', 'volume_size': 1} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=92fc20b6-1522-47ca-8b49-093e6fe728b5,created_at=2026-04-07T04:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634674798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92fc20b6-1522-47ca-8b49-093e6fe728b5,host='devstack@QuobyteHD#QuobyteHD',id=0cd9e12a-b00d-446b-adcb-2eaaef893840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7cacf7fc284a2f85d6b8e66fef0325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:19Z,use_quota=True,user_id='9b72c5a045894734b4f54192f70ca8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7b5b886-79f4-418c-8b0d-0a06f9d25d15),volume_type_id=a7b5b886-79f4-418c-8b0d-0a06f9d25d15)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Creating volume 0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:19 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Acquiring lock "cinder-82ef3504-89f8-4a31-b066-ac9892bd29e9-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:19 devstack sudo[84675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 1073741824 Apr 07 06:06:19 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "cinder-82ef3504-89f8-4a31-b066-ac9892bd29e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Acquiring lock "cinder-quobyte-82ef3504-89f8-4a31-b066-ac9892bd29e9" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "cinder-quobyte-82ef3504-89f8-4a31-b066-ac9892bd29e9" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3569446d-098e-495e-91f3-b6373ccfb4df]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:20 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 Apr 07 06:06:20 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:20 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 1073741824" returned: 0 in 1.259s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:21 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:21 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:21 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9" returned: 0 in 1.910s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:21 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9 Apr 07 06:06:21 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:22 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.966s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452dd7eb-7fb4-4ab5-96a1-dcf6733703fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd9e12a-b00d-446b-adcb-2eaaef893840', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794a8a0d-21bf-4456-b96f-ea29f7466c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:22 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Volume volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 (0cd9e12a-b00d-446b-adcb-2eaaef893840): created successfully Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794a8a0d-21bf-4456-b96f-ea29f7466c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Flow 'volume_create_manager' (7b352994-2a3a-4477-b073-8a2bd31f5b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-172925c5-be60-4738-ba56-b0ed675bbef3 tempest-GroupsV314Test-1426359515 None] Created volume successfully. Apr 07 06:06:22 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-82ef3504-89f8-4a31-b066-ac9892bd29e9" returned: 0 in 1.133s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "cinder-quobyte-82ef3504-89f8-4a31-b066-ac9892bd29e9" released by "delete_volume" :: held 3.092s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:22 devstack cinder-volume[83450]: WARNING cinder.quota [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:22 devstack cinder-volume[83450]: WARNING cinder.quota [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:22 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Created reservations ['2e9a64ee-0133-4fb6-9b6a-38931f992aeb', '134f298c-731f-440a-96cc-95c927aa5435', '05795f5d-581d-4d31-82fe-8da03de3be41', 'e89daf02-c0ba-445c-8ca8-26e0c92200c1'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:23 devstack sudo[84716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:23 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:24 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.376s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Deleted volume successfully. Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-44568c59-9708-4473-8e79-8039788c224b tempest-VolumesAdminNegativeTest-655018964 None] Lock "cinder-82ef3504-89f8-4a31-b066-ac9892bd29e9-delete_volume" released by "delete_volume" :: held 4.840s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:24 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Cloning volume 0cd9e12a-b00d-446b-adcb-2eaaef893840 to volume 0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 Apr 07 06:06:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Creating offline snapshot b771b884-5c0f-43c7-94ba-e7c8d4b32816 of volume 0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:06:25 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98cd555-92ea-4890-b2b7-c044f009a381]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:25 devstack sudo[84771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:25 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:26 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 1.089s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:26 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 1G Apr 07 06:06:26 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:27 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 1G" returned: 0 in 0.930s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:27 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:27 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:27 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-ea8f0682-59a6-4f29-975a-39e20b617622 req-b62d5a9c-a5b8-42be-983d-a794c1e3e2d4 tempest-DeleteServersTestJSON-1578197769 None] Terminate volume connection completed successfully. Apr 07 06:06:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-ea8f0682-59a6-4f29-975a-39e20b617622 req-b62d5a9c-a5b8-42be-983d-a794c1e3e2d4 tempest-DeleteServersTestJSON-1578197769 None] Deleting attachment c6880b83-96db-43f7-922c-c56897b81110. {{(pid=83450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:06:27 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.802s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:27 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:27 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:27 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:28 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.636s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:28 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info Apr 07 06:06:28 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:29 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info" returned: 0 in 0.769s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:29 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:29 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info Apr 07 06:06:29 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:30 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.info" returned: 0 in 0.773s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Acquiring lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] snapshot: b771b884-5c0f-43c7-94ba-e7c8d4b32816, volume: 0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[555573fe-0989-4cb8-b5c5-2aec5b29fb00]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:30 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:30 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:30 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.707s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd9e12a-b00d-446b-adcb-2eaaef893840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d97704-b033-47c7-b59e-fb21dbcba2cd]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:31 devstack sudo[84811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:31 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:31 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.873s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:31 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:06:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:31 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 Apr 07 06:06:31 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "cinder-829cb216-7abb-4ea7-8abf-e5adf420dd38-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "cinder-829cb216-7abb-4ea7-8abf-e5adf420dd38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "cinder-quobyte-829cb216-7abb-4ea7-8abf-e5adf420dd38" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "cinder-quobyte-829cb216-7abb-4ea7-8abf-e5adf420dd38" acquired by "delete_volume" :: waited 0.020s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:32 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d8f47-dfa9-4a04-b788-19985c4d0235]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:32 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 Apr 07 06:06:32 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:33 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38" returned: 0 in 1.309s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:33 devstack sudo[84854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38 Apr 07 06:06:33 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:35 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-829cb216-7abb-4ea7-8abf-e5adf420dd38" returned: 0 in 1.816s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "cinder-quobyte-829cb216-7abb-4ea7-8abf-e5adf420dd38" released by "delete_volume" :: held 3.189s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Created reservations ['8fc4e893-8c5f-4c22-b5c3-b479aafa23a9', 'f2d88cfc-ffde-42a5-85f8-71f8475d32e4', '18a08624-2592-4ec4-a702-b77627789933', '5f1dbc6a-2fed-4fa3-a382-e98c6c6d3eaf'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:35 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:35 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:35 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" returned: 0 in 3.794s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc69d82-ecbd-43bd-a2bc-6fe17a5e1665]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:35 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:35 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:36 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.775s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Deleted volume successfully. Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0549e899-e2fb-4060-8cef-30e0e5481f8a tempest-DeleteServersTestJSON-1578197769 None] Lock "cinder-829cb216-7abb-4ea7-8abf-e5adf420dd38-delete_volume" released by "delete_volume" :: held 4.306s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:36 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.847s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:06:36 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Converted 1024.00 MB image at 269.65 MB/s Apr 07 06:06:36 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:36 devstack sudo[84871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 Apr 07 06:06:36 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:37 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" returned: 0 in 0.674s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" released by "_copy_volume_from_snapshot" :: held 7.007s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Acquiring lock "cinder-quobyte-b771b884-5c0f-43c7-94ba-e7c8d4b32816" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-b771b884-5c0f-43c7-94ba-e7c8d4b32816" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Deleting offline snapshot b771b884-5c0f-43c7-94ba-e7c8d4b32816 of volume 0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] snapshot_file for this snap is: volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65b304-ac15-4af6-b175-920a10804cc5]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:37 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:37 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:38 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.764s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd9e12a-b00d-446b-adcb-2eaaef893840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7b294-d4a2-4ad8-bba7-5d843ab52a50]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:38 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:38 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:38 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.863s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:38 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:38 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:39 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.678s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:39 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816 Apr 07 06:06:39 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:40 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840.b771b884-5c0f-43c7-94ba-e7c8d4b32816" returned: 0 in 0.624s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-b771b884-5c0f-43c7-94ba-e7c8d4b32816" released by "_delete_snapshot" :: held 3.035s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.410s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f41ba9e1-6eaa-430e-b963-834ef57dd1d9 tempest-GroupsV314Test-1426359515 None] Create group from source-group-92fc20b6-1522-47ca-8b49-093e6fe728b5 completed successfully. Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=60,cinder:UPDATE=59,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=54,cinder:UPDATE=50,cinder:DELETE=4,cinder:INSERT=15 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Acquiring lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c4eba3-0eed-4d4b-9af1-07f8a00318db]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:41 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 Apr 07 06:06:41 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:42 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" returned: 0 in 0.863s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:42 devstack sudo[84923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1 Apr 07 06:06:42 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:43 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" returned: 0 in 0.723s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0e44dcb2-5d8f-42c7-9bd7-a837e7676bc1" released by "delete_volume" :: held 1.626s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Created reservations ['c264269b-806f-4cd7-b4d8-50ae4e62cf4a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:43 devstack cinder-volume[83450]: WARNING cinder.quota [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-791659276 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-791659276, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:43 devstack cinder-volume[83450]: WARNING cinder.quota [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-791659276 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-791659276, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Created reservations ['46bcaacb-a613-4fea-beca-2b1fb1f4e074', 'a9c0342f-c9cb-4644-ab43-8129f6b57f08', '487a9d6f-93a2-4d0d-bfa9-cd7048ed7ac6', '78e22843-77b6-4805-bad2-fc1492681699'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:43 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:43 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Acquiring lock "cinder-quobyte-0cd9e12a-b00d-446b-adcb-2eaaef893840" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:44 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.750s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0cd9e12a-b00d-446b-adcb-2eaaef893840" acquired by "delete_volume" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0c9bd736-5ae6-4cd4-b8b8-5de2fd8f80ed tempest-GroupsV314Test-1426359515 None] Delete group completed successfully. Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ccb8c-8600-4117-80ab-48b988c2e12a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:44 devstack sudo[84930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:44 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:45 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.724s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:45 devstack sudo[84935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840 Apr 07 06:06:45 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:45 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0cd9e12a-b00d-446b-adcb-2eaaef893840" returned: 0 in 0.736s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Lock "cinder-quobyte-0cd9e12a-b00d-446b-adcb-2eaaef893840" released by "delete_volume" :: held 1.526s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:45 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Created reservations ['4941c080-746e-4360-a1f9-af1c95d9a28a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Created reservations ['8f29eb60-10a2-455c-a2c0-ddc66a4e5640', '37e95cba-59b9-41f4-9aac-b1cf888101a2', '2c7f05e6-498d-469f-b6e2-3bee8f46e666', '44f2d922-8a70-4bd5-9efb-b9eda573b1ec'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:46 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:46 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:46 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:06:46 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:46 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.807s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8c87a39b-0858-4730-93f2-60247021a1a3 tempest-GroupsV314Test-1426359515 None] Delete group completed successfully. Apr 07 06:06:47 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.741s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4a204340-babd-4fe2-b444-4c6749474bca tempest-GroupsV320Test-1509939002 None] Group tempest-GroupsV320Test-Group-376213333: creating Apr 07 06:06:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4a204340-babd-4fe2-b444-4c6749474bca tempest-GroupsV320Test-1509939002 None] Group tempest-GroupsV320Test-Group-376213333: created successfully Apr 07 06:06:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4a204340-babd-4fe2-b444-4c6749474bca tempest-GroupsV320Test-1509939002 None] Create group completed successfully. Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Created reservations ['43b37a66-3ac9-4425-aa63-77c79a4329a7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:01 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:07:01 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:02 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.803s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:02 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8cb76e15-579b-4b81-bb8f-0cf7c8e5b5ad tempest-GroupsV320Test-1509939002 None] Delete group completed successfully. Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Flow 'volume_create_manager' (6efb881b-4eff-4936-a2e2-1b6ad9d88c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac8f856-a6b6-4394-a367-91f7b7d504cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac8f856-a6b6-4394-a367-91f7b7d504cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-245917761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5c6a3c-ad50-48f0-8a25-149554f9048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9838017bf644eca918f56dc13909709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:04Z,use_quota=True,user_id='f5600eb4ee8646e794bc61d5a7c66ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ce5525-0a9e-4392-8dc6-453e75eeef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ce5525-0a9e-4392-8dc6-453e75eeef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a7c66c-bc33-4646-bd3b-2fee9fffd4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a7c66c-bc33-4646-bd3b-2fee9fffd4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5c6a3c-ad50-48f0-8a25-149554f9048a', 'volume_name': 'volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0634b8ac-887e-4996-906e-2d9352b352d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0634b8ac-887e-4996-906e-2d9352b352d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167312a1-9018-40f4-856c-8682724d5d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:04 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Volume bf5c6a3c-ad50-48f0-8a25-149554f9048a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a', 'volume_size': 1} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-245917761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5c6a3c-ad50-48f0-8a25-149554f9048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9838017bf644eca918f56dc13909709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:04Z,use_quota=True,user_id='f5600eb4ee8646e794bc61d5a7c66ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Creating volume bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:04 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:04 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a 1073741824 Apr 07 06:07:04 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:05 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a 1073741824" returned: 0 in 1.147s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:05 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a Apr 07 06:07:05 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:06 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a" returned: 0 in 1.293s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167312a1-9018-40f4-856c-8682724d5d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e267a6b-2acd-4843-accc-5cfea0592efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:06 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Volume volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a (bf5c6a3c-ad50-48f0-8a25-149554f9048a): created successfully Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e267a6b-2acd-4843-accc-5cfea0592efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Flow 'volume_create_manager' (6efb881b-4eff-4936-a2e2-1b6ad9d88c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:06 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-54911e0e-0c79-4b5f-982b-adf538660a5d req-180c33cf-ee9a-4277-a1a4-ff142080fd7c tempest-VolumesSnapshotsTestJSON-1860884905 None] Created volume successfully. Apr 07 06:07:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Creating offline snapshot 48406bfb-b0ce-4be0-aa38-fcb1fcd6573b of volume bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:07:07 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77636ded-bbb4-4cc9-9148-88f2ca39b62d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:08 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a Apr 07 06:07:08 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:09 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a" returned: 0 in 1.508s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:09 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b 1G Apr 07 06:07:09 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:10 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b 1G" returned: 0 in 1.169s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:10 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b Apr 07 06:07:10 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Flow 'volume_create_manager' (f1240c51-92f2-4d49-a495-02c3b804bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832f6ea-fc5a-4da7-818b-2aeab885a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832f6ea-fc5a-4da7-818b-2aeab885a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-859757148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170741e-5d0f-44f8-9e61-5b6235fff6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fad22c95b8b4732960c7b91a9ed20ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:11Z,use_quota=True,user_id='fc0250d40d27456f84af1d9f1a098869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07c6fb-1685-441a-b986-0828acb17814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07c6fb-1685-441a-b986-0828acb17814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc30b74-97b5-4f1c-8a84-fc12b001dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc30b74-97b5-4f1c-8a84-fc12b001dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f170741e-5d0f-44f8-9e61-5b6235fff6f9', 'volume_name': 'volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7deed02-4b99-4070-bede-80ab2b0070e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7deed02-4b99-4070-bede-80ab2b0070e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87809020-e1af-420d-b50e-d5b38427d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Volume f170741e-5d0f-44f8-9e61-5b6235fff6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9', 'volume_size': 1} Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:11 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" returned: 0 in 1.088s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:11 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b is being set with open permissions: ugo+rw Apr 07 06:07:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:11 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b Apr 07 06:07:11 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:12 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" returned: 0 in 0.838s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:12 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info Apr 07 06:07:12 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:13 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info" returned: 0 in 0.741s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:13 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info is being set with open permissions: ugo+rw Apr 07 06:07:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:13 devstack sudo[85150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info Apr 07 06:07:13 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:14 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.info" returned: 0 in 0.735s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.218s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.755s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-859757148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170741e-5d0f-44f8-9e61-5b6235fff6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fad22c95b8b4732960c7b91a9ed20ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:11Z,use_quota=True,user_id='fc0250d40d27456f84af1d9f1a098869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Creating volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:14 devstack sudo[85157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 1073741824 Apr 07 06:07:14 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-37b03ecd-9a2b-462e-b278-e8412ff8a5b1 req-7a23b4bc-0408-4dba-b5dd-edb977c6e080 tempest-VolumesSnapshotsTestJSON-1860884905 None] Create snapshot completed successfully Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "cinder-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "cinder-quobyte-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Deleting offline snapshot 48406bfb-b0ce-4be0-aa38-fcb1fcd6573b of volume bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] snapshot_file for this snap is: volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536df25-802a-4d43-9798-fe8d4f25d322]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:14 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b Apr 07 06:07:14 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:14 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 1073741824" returned: 0 in 0.869s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:15 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 Apr 07 06:07:15 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:15 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" returned: 0 in 1.269s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[637047ea-31fa-4928-98a2-375ab31e6b4d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:16 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a Apr 07 06:07:16 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:16 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9" returned: 0 in 1.535s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] <== create_volume: return (2447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87809020-e1af-420d-b50e-d5b38427d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddc06c6-707c-49db-8e7a-8b0731bbe780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:16 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Volume volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 (f170741e-5d0f-44f8-9e61-5b6235fff6f9): created successfully Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddc06c6-707c-49db-8e7a-8b0731bbe780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Flow 'volume_create_manager' (f1240c51-92f2-4d49-a495-02c3b804bdef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-64b3d012-6b15-483e-850f-12cb5779cd52 tempest-SnapshotsActionsTest-698254328 None] Created volume successfully. Apr 07 06:07:17 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a" returned: 0 in 1.283s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:17 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b Apr 07 06:07:17 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:18 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" returned: 0 in 1.376s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:18 devstack sudo[85259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b Apr 07 06:07:18 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Creating offline snapshot d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc77316e-0a32-43c5-8d73-2fcd051eafa0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:19 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 Apr 07 06:07:19 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Flow 'volume_create_manager' (62e90a9d-e0e3-499b-9ff3-1cb342d7509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc0f153-0bb0-4aa8-83f8-7aece19ff372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc0f153-0bb0-4aa8-83f8-7aece19ff372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:19Z,deleted=False,deleted_at=None,display_description='',display_name='a553530d-00ca-403f-8667-782e7186f198-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e2e06-57b1-4a05-8a72-f5624fdbc343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0e57567d244af59f9f98814c5ccf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:19Z,use_quota=True,user_id='69d929bb4abf40158bc01d609bd7ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa628c9-dbd6-4559-9736-b08091dfdf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa628c9-dbd6-4559-9736-b08091dfdf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9566b2-acd5-4d4c-b17b-3fc9b5762bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9566b2-acd5-4d4c-b17b-3fc9b5762bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28e2e06-57b1-4a05-8a72-f5624fdbc343', 'volume_name': 'volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce5a16c-2560-475d-8ff2-19ab99348289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce5a16c-2560-475d-8ff2-19ab99348289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa7294f-fe05-4844-979a-d6e7f4478b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:19 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume b28e2e06-57b1-4a05-8a72-f5624fdbc343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343', 'volume_size': 1} Apr 07 06:07:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:20 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a.48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" returned: 0 in 1.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b" released by "_delete_snapshot" :: held 5.534s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" released by "delete_snapshot" :: held 5.570s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:20 devstack cinder-volume[83450]: WARNING cinder.quota [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:07:20 devstack cinder-volume[83450]: DEBUG cinder.quota [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Created reservations ['5e9e2733-8e0b-47c6-acb7-440900602b89', 'b572710a-d26b-42d6-a9ba-bd609fa66cba', '08f1b00e-4be9-40ec-bd75-df3e4b51db9e', '0f32573a-4c7e-475d-973a-363620f9504a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Delete snapshot completed successfully. Apr 07 06:07:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-a9b949af-74e8-49cd-a393-8e57d8ddb026 req-de3b61fe-f2e8-4b06-9566-03a1b0764d14 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-48406bfb-b0ce-4be0-aa38-fcb1fcd6573b-delete_snapshot" released by "delete_snapshot" :: held 5.914s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:21 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9" returned: 0 in 2.211s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:21 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 1G Apr 07 06:07:21 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "cinder-bf5c6a3c-ad50-48f0-8a25-149554f9048a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-bf5c6a3c-ad50-48f0-8a25-149554f9048a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:22 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e3466-1164-4ae7-9a5f-38f1fc39bf81]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:22 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a Apr 07 06:07:22 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:23 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 1G" returned: 0 in 2.007s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:23 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:23 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:23 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a" returned: 0 in 1.412s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:23 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a Apr 07 06:07:23 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:24 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bf5c6a3c-ad50-48f0-8a25-149554f9048a" returned: 0 in 0.933s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-quobyte-bf5c6a3c-ad50-48f0-8a25-149554f9048a" released by "delete_volume" :: held 2.528s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG cinder.quota [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Created reservations ['99d41b4c-6cc7-4c12-8330-f40053e7fc72', '0fecaa9b-61b8-44fe-9825-be95658dc157', '7684148b-0b85-416b-b665-8a3ac542dff2', '0d06788d-701e-4eb9-a33d-457bb86df6e8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:24 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.516s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:24 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 is being set with open permissions: ugo+rw Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:24 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:24 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:24 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:07:24 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:26 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.212s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:26 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info Apr 07 06:07:26 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:26 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.567s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:26 devstack cinder-volume[83450]: DEBUG cinder.manager [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Deleted volume successfully. Apr 07 06:07:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-9a98604a-f8a6-4c92-a36d-88e06d156c39 req-d855fb25-12e1-469d-8f81-c6bf0707e573 tempest-VolumesSnapshotsTestJSON-1860884905 None] Lock "cinder-bf5c6a3c-ad50-48f0-8a25-149554f9048a-delete_volume" released by "delete_volume" :: held 4.561s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:27 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info" returned: 0 in 0.937s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:27 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info is being set with open permissions: ugo+rw Apr 07 06:07:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:27 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info Apr 07 06:07:27 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:28 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.info" returned: 0 in 1.103s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.241s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.249s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:19Z,deleted=False,deleted_at=None,display_description='',display_name='a553530d-00ca-403f-8667-782e7186f198-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e2e06-57b1-4a05-8a72-f5624fdbc343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0e57567d244af59f9f98814c5ccf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:19Z,use_quota=True,user_id='69d929bb4abf40158bc01d609bd7ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Creating volume b28e2e06-57b1-4a05-8a72-f5624fdbc343 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:28 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:28 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 1073741824 Apr 07 06:07:28 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:28 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a802d061-a99c-4bed-934b-74e86fd41161 tempest-SnapshotsActionsTest-698254328 None] Create snapshot completed successfully Apr 07 06:07:29 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 1073741824" returned: 0 in 1.353s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:29 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 Apr 07 06:07:29 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:30 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343" returned: 0 in 0.968s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa7294f-fe05-4844-979a-d6e7f4478b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6394f1-27b4-45cb-b956-b077eefb7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Creating offline snapshot 5b608535-0e72-4d73-b3ec-f0320e56acb9 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:07:30 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 (b28e2e06-57b1-4a05-8a72-f5624fdbc343): created successfully Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6394f1-27b4-45cb-b956-b077eefb7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Flow 'volume_create_manager' (62e90a9d-e0e3-499b-9ff3-1cb342d7509f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6525e996-e9f0-44ec-8fb8-4b9d46a7500f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:30 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-93758ba3-f620-4171-b3d9-ff9ce8013866 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Created volume successfully. Apr 07 06:07:30 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:30 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:31 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Flow 'volume_create_manager' (32f52476-5e08-43a5-932a-b1ae69478509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ed03f2-d974-40d7-8a90-29c7ecee6e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:32 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.197s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ed03f2-d974-40d7-8a90-29c7ecee6e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1701211130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9f2aba-7e27-4632-8b6d-a0dada7647c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f789c67118e84e07967cf4dc4d97b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:32Z,use_quota=True,user_id='e6e909996b4c44199a65e7067959cdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e7bc7-9d1c-4a57-a9c0-9c5f278575de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e7bc7-9d1c-4a57-a9c0-9c5f278575de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc7747-b0f3-4b0c-9b6f-180fc5de7e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc7747-b0f3-4b0c-9b6f-180fc5de7e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9f2aba-7e27-4632-8b6d-a0dada7647c5', 'volume_name': 'volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:32 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 1G Apr 07 06:07:32 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2153ef-f34b-4cb5-90dd-c4942b759c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2153ef-f34b-4cb5-90dd-c4942b759c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029a0c98-14d0-4eec-b2f9-a0f4d73d9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Volume 0c9f2aba-7e27-4632-8b6d-a0dada7647c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5', 'volume_size': 1} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:33 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 1G" returned: 0 in 1.009s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:33 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 Apr 07 06:07:33 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:33 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9" returned: 0 in 0.773s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:33 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 is being set with open permissions: ugo+rw Apr 07 06:07:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:33 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 Apr 07 06:07:33 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:34 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9" returned: 0 in 0.933s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1701211130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9f2aba-7e27-4632-8b6d-a0dada7647c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f789c67118e84e07967cf4dc4d97b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:32Z,use_quota=True,user_id='e6e909996b4c44199a65e7067959cdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Creating volume 0c9f2aba-7e27-4632-8b6d-a0dada7647c5 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:34 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:34 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 1073741824 Apr 07 06:07:34 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d2cc7524-58d6-43ac-ac80-604e955b7d44 tempest-SnapshotsActionsTest-698254328 None] Create snapshot completed successfully Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-5b608535-0e72-4d73-b3ec-f0320e56acb9-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-5b608535-0e72-4d73-b3ec-f0320e56acb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-5b608535-0e72-4d73-b3ec-f0320e56acb9" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-5b608535-0e72-4d73-b3ec-f0320e56acb9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Deleting offline snapshot 5b608535-0e72-4d73-b3ec-f0320e56acb9 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] snapshot_file for this snap is: volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdfb979-0d84-45c4-8a7f-6036d722136d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:36 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 1073741824" returned: 0 in 1.147s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:36 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 Apr 07 06:07:36 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:36 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 Apr 07 06:07:36 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Flow 'volume_create_manager' (be533f37-8530-45ca-921f-d0d109082858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68abfc5-0c7e-40ad-ae78-1826ff71fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68abfc5-0c7e-40ad-ae78-1826ff71fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1375943386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa37079f-c4d4-463b-bbc4-d3a3497511ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b9e1233a114ef29e404ceea05c00a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:36Z,use_quota=True,user_id='fe31bda73baa4f95b06bef6ee31f4aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718b63a-d822-4838-8755-b3bb74b798d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718b63a-d822-4838-8755-b3bb74b798d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11984db5-432b-467b-b1e5-1c6a33cea86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11984db5-432b-467b-b1e5-1c6a33cea86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa37079f-c4d4-463b-bbc4-d3a3497511ab', 'volume_name': 'volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bc19e-060d-4bf3-8b6b-56110ab86145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bc19e-060d-4bf3-8b6b-56110ab86145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7061817b-f9d6-45d5-b92a-3542930e0eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Volume fa37079f-c4d4-463b-bbc4-d3a3497511ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab', 'volume_size': 1} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:36 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9" returned: 0 in 1.016s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb57f187-3ece-4e58-9469-7ec75fefb5f3]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:37 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:37 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:37 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" returned: 0 in 1.039s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.343s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7362d0-5c29-4097-9575-071eb573b063]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029a0c98-14d0-4eec-b2f9-a0f4d73d9894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c42e30-8b8a-40a4-9950-3930b71eb485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:37 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Volume volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 (0c9f2aba-7e27-4632-8b6d-a0dada7647c5): created successfully Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c42e30-8b8a-40a4-9950-3930b71eb485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Flow 'volume_create_manager' (32f52476-5e08-43a5-932a-b1ae69478509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:37 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-a9a7735e-69b2-4283-bf02-fcdc0d3e6789 req-b93d9b1e-98b0-4465-8b2e-9549cf7f2c5a tempest-VolumesGetTestJSON-793898945 None] Created volume successfully. Apr 07 06:07:37 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 Apr 07 06:07:37 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:37 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.735s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:37 devstack sudo[85436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 Apr 07 06:07:37 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:38 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343" returned: 0 in 1.057s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1375943386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa37079f-c4d4-463b-bbc4-d3a3497511ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b9e1233a114ef29e404ceea05c00a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:36Z,use_quota=True,user_id='fe31bda73baa4f95b06bef6ee31f4aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Creating volume fa37079f-c4d4-463b-bbc4-d3a3497511ab {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:38 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Acquiring lock "cinder-0c9f2aba-7e27-4632-8b6d-a0dada7647c5-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "cinder-0c9f2aba-7e27-4632-8b6d-a0dada7647c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:38 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab 1073741824 Apr 07 06:07:38 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9', 'name': 'volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32499895-67cd-4c87-92c4-b89d2d8cdfbf', 'enforce_multipath': True} {{(pid=83450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Acquiring lock "cinder-quobyte-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "cinder-quobyte-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" acquired by "delete_volume" :: waited 0.057s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e5d6a1-0502-444a-8bd2-708b23fcb96f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-d24e7e2a-051c-4d09-8ded-5de37045fb94 req-b2fc912c-7496-44a5-a00c-442c09f4b7b5 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] attachment_update completed successfully. Apr 07 06:07:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:38 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 Apr 07 06:07:38 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:39 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9" returned: 0 in 1.656s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:39 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" returned: 0 in 0.810s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:39 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab 1073741824" returned: 0 in 1.179s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:39 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9 Apr 07 06:07:39 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:39 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5 Apr 07 06:07:39 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:39 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab Apr 07 06:07:39 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:40 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5b608535-0e72-4d73-b3ec-f0320e56acb9" returned: 0 in 1.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-5b608535-0e72-4d73-b3ec-f0320e56acb9" released by "_delete_snapshot" :: held 5.075s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_snapshot" :: held 5.120s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:40 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab" returned: 0 in 1.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] <== create_volume: return (2776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.782s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7061817b-f9d6-45d5-b92a-3542930e0eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:41 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049b4d4-54b0-4030-af2c-f77b48e1d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" returned: 0 in 1.683s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "cinder-quobyte-0c9f2aba-7e27-4632-8b6d-a0dada7647c5" released by "delete_volume" :: held 2.651s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Volume volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab (fa37079f-c4d4-463b-bbc4-d3a3497511ab): created successfully Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049b4d4-54b0-4030-af2c-f77b48e1d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Flow 'volume_create_manager' (be533f37-8530-45ca-921f-d0d109082858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:41 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5fcd6f8d-a185-43f7-a84e-32259ca0b6ab tempest-ServerRescueNegativeTestJSON-1462599911 None] Created volume successfully. Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Created reservations ['5ba19ed7-7331-49e3-abad-2ba2c197f3d8', '428e0923-106f-436e-b11f-2ae07d5976c5', 'f7f7c33f-fa83-48f4-8e61-f7d1531fd807', 'dc61ea2a-b693-488c-b285-1ff7fc082496'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:41 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Delete snapshot completed successfully. Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f6c982d-7ddb-491d-9cd6-0e80288777bf tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-5b608535-0e72-4d73-b3ec-f0320e56acb9-delete_snapshot" released by "delete_snapshot" :: held 5.579s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.quota [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Created reservations ['482cdc8c-2a3e-4a87-b439-e9ab38d7c9f1', '3334a0ba-b2d1-4900-a463-a73b414f1238', 'f8e94778-f0e4-4b39-ae70-32dea404c060', '89744136-ab69-47f8-afc3-fc8b3db80e2f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:41 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:07:41 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:42 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=64,cinder:INSERT=15,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.259s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG cinder.manager [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=77,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=3 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:07:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Deleted volume successfully. Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Creating offline snapshot c8f3da32-609d-4377-ba30-6c201c3a3ab2 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-4fe99d58-a3a0-418c-b4dd-e1d236c7ef78 req-60ebcb68-dc15-43a1-956e-8f6aa5e80a31 tempest-VolumesGetTestJSON-793898945 None] Lock "cinder-0c9f2aba-7e27-4632-8b6d-a0dada7647c5-delete_volume" released by "delete_volume" :: held 4.635s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73108a9-4298-41df-aa15-9c43c53ca6b0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:43 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:43 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:44 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:44 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 1G Apr 07 06:07:44 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:46 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 1G" returned: 0 in 1.975s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:46 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:07:46 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:46 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 Apr 07 06:07:46 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:47 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2" returned: 0 in 1.345s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:47 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 is being set with open permissions: ugo+rw Apr 07 06:07:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:47 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.380s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:47 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 Apr 07 06:07:47 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:48 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2" returned: 0 in 0.684s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.609s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b9e486af-479a-4004-aeb3-f77c8643273d tempest-SnapshotsActionsTest-698254328 None] Create snapshot completed successfully Apr 07 06:07:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8b8e37ac-8a56-4538-b9e4-794e0511bfd3 tempest-GroupsTest-355572630 None] Group tempest-Group1-85281189: creating Apr 07 06:07:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8b8e37ac-8a56-4538-b9e4-794e0511bfd3 tempest-GroupsTest-355572630 None] Group tempest-Group1-85281189: created successfully Apr 07 06:07:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8b8e37ac-8a56-4538-b9e4-794e0511bfd3 tempest-GroupsTest-355572630 None] Create group completed successfully. Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-c8f3da32-609d-4377-ba30-6c201c3a3ab2-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-c8f3da32-609d-4377-ba30-6c201c3a3ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-c8f3da32-609d-4377-ba30-6c201c3a3ab2" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-c8f3da32-609d-4377-ba30-6c201c3a3ab2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Deleting offline snapshot c8f3da32-609d-4377-ba30-6c201c3a3ab2 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] snapshot_file for this snap is: volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a6ef2-5e9d-4d75-a043-3212a056438a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:49 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 Apr 07 06:07:49 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ae02fd73-0b7f-4b59-a3ab-57ea794b0d98 tempest-GroupsTest-355572630 None] Group tempest-Group2-1283229324: creating Apr 07 06:07:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ae02fd73-0b7f-4b59-a3ab-57ea794b0d98 tempest-GroupsTest-355572630 None] Group tempest-Group2-1283229324: created successfully Apr 07 06:07:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ae02fd73-0b7f-4b59-a3ab-57ea794b0d98 tempest-GroupsTest-355572630 None] Create group completed successfully. Apr 07 06:07:50 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2" returned: 0 in 0.748s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a07d8-4eab-471f-8fa0-6b810a70c9e3]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:50 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:50 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:50 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.558s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:50 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 Apr 07 06:07:50 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:52 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2" returned: 0 in 1.239s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:52 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2 Apr 07 06:07:52 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (fa82d120-bb0c-4cd6-8c60-6f556913476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e977a8-2d1b-43f1-b86a-49f43525b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e977a8-2d1b-43f1-b86a-49f43525b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1356559190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6476d122-7daf-43c5-9cf4-a6764e65bc2d,host='devstack@QuobyteHD#QuobyteHD',id=66d093fd-d228-49a7-acbc-3acd67ac018e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:52Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5758ce44-9c3c-4693-8ffe-ea1c1fb481f7),volume_type_id=5758ce44-9c3c-4693-8ffe-ea1c1fb481f7)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50947421-7288-48b6-9c65-05685cdaa8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50947421-7288-48b6-9c65-05685cdaa8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05f7dbf-2c19-4be6-b5be-515e6a6cbb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05f7dbf-2c19-4be6-b5be-515e6a6cbb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d093fd-d228-49a7-acbc-3acd67ac018e', 'volume_name': 'volume-66d093fd-d228-49a7-acbc-3acd67ac018e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c6a89c-4ae9-40da-909b-ebea0132d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c6a89c-4ae9-40da-909b-ebea0132d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68852fe1-e992-4a87-b86a-b366ef08b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:52 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Volume 66d093fd-d228-49a7-acbc-3acd67ac018e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d093fd-d228-49a7-acbc-3acd67ac018e', 'volume_size': 1} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6476d122-7daf-43c5-9cf4-a6764e65bc2d,created_at=2026-04-07T04:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1356559190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6476d122-7daf-43c5-9cf4-a6764e65bc2d,host='devstack@QuobyteHD#QuobyteHD',id=66d093fd-d228-49a7-acbc-3acd67ac018e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:52Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5758ce44-9c3c-4693-8ffe-ea1c1fb481f7),volume_type_id=5758ce44-9c3c-4693-8ffe-ea1c1fb481f7)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Creating volume 66d093fd-d228-49a7-acbc-3acd67ac018e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:52 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:07:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:52 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e 1073741824 Apr 07 06:07:52 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:53 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.c8f3da32-609d-4377-ba30-6c201c3a3ab2" returned: 0 in 1.402s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-c8f3da32-609d-4377-ba30-6c201c3a3ab2" released by "_delete_snapshot" :: held 4.059s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_snapshot" :: held 4.078s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Created reservations ['262538a8-7216-461e-bb19-30e8bb831514', '39df4cc3-7829-4c73-95bc-c7fd1e9f4e39', '2f49dc32-7076-4cb2-bcd4-4881f098721c', '0b0e6ecf-85f1-4ef1-817d-c7e919c16df0'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Delete snapshot completed successfully. Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5cfa9b7f-9376-45e1-af80-1252f089a4e4 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-c8f3da32-609d-4377-ba30-6c201c3a3ab2-delete_snapshot" released by "delete_snapshot" :: held 4.351s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:53 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e 1073741824" returned: 0 in 1.535s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:54 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e Apr 07 06:07:54 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:54 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e" returned: 0 in 0.950s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.604s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68852fe1-e992-4a87-b86a-b366ef08b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d093fd-d228-49a7-acbc-3acd67ac018e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197d08e5-5614-45f6-b1e8-89445fcda84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Creating offline snapshot 5dcebd08-7891-4534-a505-d175b9bdc43a of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:07:55 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Volume volume-66d093fd-d228-49a7-acbc-3acd67ac018e (66d093fd-d228-49a7-acbc-3acd67ac018e): created successfully Apr 07 06:07:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197d08e5-5614-45f6-b1e8-89445fcda84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (fa82d120-bb0c-4cd6-8c60-6f556913476a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:55 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56c8ee2-acf2-47af-81b4-b06f3ac384fc]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:55 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f291c834-1a0e-40e6-be69-49ed3604b158 tempest-GroupsTest-355572630 None] Created volume successfully. Apr 07 06:07:55 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:07:55 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:57 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 2.103s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:57 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a 1G Apr 07 06:07:57 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Acquiring lock "cinder-quobyte-66d093fd-d228-49a7-acbc-3acd67ac018e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-66d093fd-d228-49a7-acbc-3acd67ac018e" acquired by "delete_volume" :: waited 0.033s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cce995-01e7-4508-975f-91b17b5d266c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:57 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e Apr 07 06:07:57 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:58 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a 1G" returned: 0 in 1.618s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:58 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a Apr 07 06:07:58 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:59 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e" returned: 0 in 1.558s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:59 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e Apr 07 06:07:59 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:00 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a" returned: 0 in 1.393s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:00 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a is being set with open permissions: ugo+rw Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:00 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a Apr 07 06:08:00 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:00 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-66d093fd-d228-49a7-acbc-3acd67ac018e" returned: 0 in 1.460s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-66d093fd-d228-49a7-acbc-3acd67ac018e" released by "delete_volume" :: held 3.143s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Created reservations ['37ceb711-509e-4183-903d-c5d214fe2587'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:00 devstack cinder-volume[83450]: WARNING cinder.quota [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2056017174 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2056017174, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:00 devstack cinder-volume[83450]: WARNING cinder.quota [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2056017174 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2056017174, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Created reservations ['2648a1d2-0401-45f6-bd62-edbed93ef5e9', '862b308b-62fe-4815-a3fd-fb1357ce6255', '10a9915e-2f75-44a3-b8ba-2153df189df9', '58cc994c-0aa5-4d85-8281-381556743239'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:00 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:00 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:00 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a" returned: 0 in 0.706s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.059s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-23ab0440-fd1d-46cc-a6c8-1e40c15ed891 tempest-SnapshotsActionsTest-698254328 None] Create snapshot completed successfully Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Created reservations ['b0dfbadd-c19b-4b19-b239-46c36092f5d6'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:01 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:01 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:01 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.814s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b3953e4d-4d46-470c-81c9-94080949416d tempest-GroupsTest-355572630 None] Delete group completed successfully. Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Acquiring lock "cinder-fa37079f-c4d4-463b-bbc4-d3a3497511ab-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "cinder-fa37079f-c4d4-463b-bbc4-d3a3497511ab-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Acquiring lock "cinder-quobyte-fa37079f-c4d4-463b-bbc4-d3a3497511ab" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "cinder-quobyte-fa37079f-c4d4-463b-bbc4-d3a3497511ab" acquired by "delete_volume" :: waited 0.024s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-5dcebd08-7891-4534-a505-d175b9bdc43a-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d126e23-19c5-4e48-99aa-cee6d2954f80]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-5dcebd08-7891-4534-a505-d175b9bdc43a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-5dcebd08-7891-4534-a505-d175b9bdc43a" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-5dcebd08-7891-4534-a505-d175b9bdc43a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Deleting offline snapshot 5dcebd08-7891-4534-a505-d175b9bdc43a of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] snapshot_file for this snap is: volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:08:02 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab Apr 07 06:08:02 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa0827-eff0-403b-8952-c5b27a2493fe]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:02 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a Apr 07 06:08:02 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:02 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.091s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b3d3340-bc1e-4428-bd69-7c9140b4ecd9 tempest-GroupsTest-355572630 None] Delete group completed successfully. Apr 07 06:08:02 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab" returned: 0 in 0.839s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:03 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab Apr 07 06:08:03 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:03 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a" returned: 0 in 1.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c6654ea9-4f25-48e0-b033-7a330a80c11a tempest-GroupsTest-355572630 None] Group tempest-GroupsTest-Group-2090297231: creating Apr 07 06:08:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f222d-9ce4-4f68-ab3d-110b30ec4e45]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c6654ea9-4f25-48e0-b033-7a330a80c11a tempest-GroupsTest-355572630 None] Group tempest-GroupsTest-Group-2090297231: created successfully Apr 07 06:08:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c6654ea9-4f25-48e0-b033-7a330a80c11a tempest-GroupsTest-355572630 None] Create group completed successfully. Apr 07 06:08:04 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:04 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:04 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fa37079f-c4d4-463b-bbc4-d3a3497511ab" returned: 0 in 1.638s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "cinder-quobyte-fa37079f-c4d4-463b-bbc4-d3a3497511ab" released by "delete_volume" :: held 2.554s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Created reservations ['8d7837eb-663a-411a-b7f6-82facfbaac56', 'ddfb04d6-1313-4111-bd50-7033693b6b8d', '2bcc5f34-1ca2-48c6-b0b9-9ee95c25c894', '77070704-c8f6-454b-9a1e-e8b65425ae1e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:04 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:04 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:04 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.024s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:04 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a Apr 07 06:08:04 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (ed873bec-b3e3-491d-a200-714f6663c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dad807-f134-4f88-bdf6-934e21acf991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dad807-f134-4f88-bdf6-934e21acf991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707294395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49520791-d5b2-4dec-9007-91e437964953,host='devstack@QuobyteHD#QuobyteHD',id=0526e506-b89c-403b-b3e7-97ad2b21bf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:06Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2),volume_type_id=aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95deac3f-4463-4399-ba74-001fe4a02bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95deac3f-4463-4399-ba74-001fe4a02bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32859098-2d58-456f-a5f9-126a8328b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32859098-2d58-456f-a5f9-126a8328b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0526e506-b89c-403b-b3e7-97ad2b21bf68', 'volume_name': 'volume-0526e506-b89c-403b-b3e7-97ad2b21bf68', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc09e43-c07c-4c80-8a42-db66ca436273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc09e43-c07c-4c80-8a42-db66ca436273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d240f89c-61a5-464c-96d8-acde8f34dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:06 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Volume 0526e506-b89c-403b-b3e7-97ad2b21bf68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0526e506-b89c-403b-b3e7-97ad2b21bf68', 'volume_size': 1} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49520791-d5b2-4dec-9007-91e437964953,created_at=2026-04-07T04:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707294395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49520791-d5b2-4dec-9007-91e437964953,host='devstack@QuobyteHD#QuobyteHD',id=0526e506-b89c-403b-b3e7-97ad2b21bf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:06Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2),volume_type_id=aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Creating volume 0526e506-b89c-403b-b3e7-97ad2b21bf68 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:06 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:06 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 1073741824 Apr 07 06:08:06 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:06 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.750s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:06 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Deleted volume successfully. Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-484006e3-efab-4bf2-9433-353300c65bf5 tempest-ServerRescueNegativeTestJSON-1462599911 None] Lock "cinder-fa37079f-c4d4-463b-bbc4-d3a3497511ab-delete_volume" released by "delete_volume" :: held 4.622s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:06 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a" returned: 0 in 1.995s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:06 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a Apr 07 06:08:06 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:07 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 1073741824" returned: 0 in 1.473s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:08 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 Apr 07 06:08:08 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:08 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.5dcebd08-7891-4534-a505-d175b9bdc43a" returned: 0 in 1.256s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-5dcebd08-7891-4534-a505-d175b9bdc43a" released by "_delete_snapshot" :: held 5.971s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_snapshot" :: held 5.997s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Created reservations ['63c0965e-64b9-47c9-b613-640df56dd414', 'f4e1067c-fde2-4272-b698-0f56a8e75cb6', '15e3c460-6ee0-4bf2-a2f6-36515d0939a1', '59113455-2e93-4870-96fa-ad2513e6975b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Delete snapshot completed successfully. Apr 07 06:08:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-344d2a5b-9a85-4bb1-8f4e-99eff367d75d tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-5dcebd08-7891-4534-a505-d175b9bdc43a-delete_snapshot" released by "delete_snapshot" :: held 6.503s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:09 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68" returned: 0 in 1.105s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] <== create_volume: return (2661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d240f89c-61a5-464c-96d8-acde8f34dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0526e506-b89c-403b-b3e7-97ad2b21bf68', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c04a30-8d45-4d87-96e6-b36e0e289589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Volume volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 (0526e506-b89c-403b-b3e7-97ad2b21bf68): created successfully Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c04a30-8d45-4d87-96e6-b36e0e289589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (ed873bec-b3e3-491d-a200-714f6663c565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:09 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-34227335-67eb-4d5c-8940-cf4f081f67ac tempest-GroupsTest-355572630 None] Created volume successfully. Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.015s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Creating offline snapshot 29e0dae6-4d52-4756-a228-12bc29f9a87b of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6d5b7b-9e9d-483a-8597-6f42b9cbb209]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:09 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:09 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:10 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 1.464s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:10 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b 1G Apr 07 06:08:10 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:10 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (3d0ef8f1-48cc-42c4-ba96-36ea1dba520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535fcbca-43ee-4837-ab3b-b340a4ca7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535fcbca-43ee-4837-ab3b-b340a4ca7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923586156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49520791-d5b2-4dec-9007-91e437964953,host='devstack@QuobyteHD#QuobyteHD',id=fb230ebb-8998-451e-9b1a-855a453cd9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:11Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2),volume_type_id=aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8de74b-610a-460c-94a9-231767ba7c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8de74b-610a-460c-94a9-231767ba7c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0beecf-0fef-4f06-9d59-92e50394ea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0beecf-0fef-4f06-9d59-92e50394ea33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb230ebb-8998-451e-9b1a-855a453cd9e5', 'volume_name': 'volume-fb230ebb-8998-451e-9b1a-855a453cd9e5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf886d90-0ac5-4fa6-9f05-30431ecca40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf886d90-0ac5-4fa6-9f05-30431ecca40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6ad96b-0255-49b8-9ebb-aa31d4f726f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Volume fb230ebb-8998-451e-9b1a-855a453cd9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb230ebb-8998-451e-9b1a-855a453cd9e5', 'volume_size': 1} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:11 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b 1G" returned: 0 in 0.839s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:11 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b Apr 07 06:08:11 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:12 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b" returned: 0 in 0.898s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:12 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b is being set with open permissions: ugo+rw Apr 07 06:08:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:12 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b Apr 07 06:08:12 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:13 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b" returned: 0 in 0.835s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.168s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49520791-d5b2-4dec-9007-91e437964953,created_at=2026-04-07T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923586156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49520791-d5b2-4dec-9007-91e437964953,host='devstack@QuobyteHD#QuobyteHD',id=fb230ebb-8998-451e-9b1a-855a453cd9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8160e0e2596542f8834609f5474e2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:11Z,use_quota=True,user_id='7a74c07be1214027b4e52b97022a8210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2),volume_type_id=aed0cfdf-7526-4d5c-bf3f-1993fb31c1c2)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Creating volume fb230ebb-8998-451e-9b1a-855a453cd9e5 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:13 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:13 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0afb50eb-a101-4b74-8650-189beb13cf46 tempest-SnapshotsActionsTest-698254328 None] Create snapshot completed successfully Apr 07 06:08:13 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 1073741824 Apr 07 06:08:13 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:14 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 1073741824" returned: 0 in 0.990s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:14 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 Apr 07 06:08:14 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-29e0dae6-4d52-4756-a228-12bc29f9a87b-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-29e0dae6-4d52-4756-a228-12bc29f9a87b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Acquiring lock "cinder-quobyte-29e0dae6-4d52-4756-a228-12bc29f9a87b" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-29e0dae6-4d52-4756-a228-12bc29f9a87b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Deleting offline snapshot 29e0dae6-4d52-4756-a228-12bc29f9a87b of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] snapshot_file for this snap is: volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9985683-db5a-4487-8d86-c3c133896767]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:15 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b Apr 07 06:08:15 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:15 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5" returned: 0 in 0.658s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6ad96b-0255-49b8-9ebb-aa31d4f726f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb230ebb-8998-451e-9b1a-855a453cd9e5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8482bf0e-c5fa-44f7-892a-943a492128fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Volume volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 (fb230ebb-8998-451e-9b1a-855a453cd9e5): created successfully Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8482bf0e-c5fa-44f7-892a-943a492128fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Flow 'volume_create_manager' (3d0ef8f1-48cc-42c4-ba96-36ea1dba520e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4d32ff0d-7179-4d6b-a731-683d9aacb2a5 tempest-GroupsTest-355572630 None] Created volume successfully. Apr 07 06:08:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-94646fea-7124-456f-b8a1-ff2a8000c642 tempest-GroupsTest-355572630 None] Update group completed successfully. Apr 07 06:08:15 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b" returned: 0 in 0.822s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f14763-d6d7-484d-9790-be6d0f4d1701]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:15 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:15 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:16 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.693s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:16 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b Apr 07 06:08:16 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-502a5342-0b15-4337-b399-74408f83219e tempest-GroupsTest-355572630 None] Update group completed successfully. Apr 07 06:08:17 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b" returned: 0 in 0.816s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:17 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b Apr 07 06:08:17 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:17 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.29e0dae6-4d52-4756-a228-12bc29f9a87b" returned: 0 in 0.542s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-29e0dae6-4d52-4756-a228-12bc29f9a87b" released by "_delete_snapshot" :: held 2.958s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_snapshot" :: held 2.976s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:17 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Created reservations ['cfc8cb2d-d72e-49ff-abe4-f94d394b6a1b', 'ad583dc1-4dd8-4d1e-ab73-fa759d1278cb', '4c060e3b-4c4b-4b75-8f12-60047866073c', '387bf4a9-3b2e-47cc-8057-dc628b552524'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Delete snapshot completed successfully. Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-184cbc7b-7383-4797-beed-d8a3a73e4a91 tempest-SnapshotsActionsTest-10577041 None] Lock "cinder-29e0dae6-4d52-4756-a228-12bc29f9a87b-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Acquiring lock "cinder-quobyte-0526e506-b89c-403b-b3e7-97ad2b21bf68" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-0526e506-b89c-403b-b3e7-97ad2b21bf68" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[92daee74-fb89-425d-a5ca-5fcb23d25f31]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "cinder-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "cinder-quobyte-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Deleting offline snapshot d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 of volume f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] snapshot_file for this snap is: volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f841aef-3ffd-4168-aaa9-797a6a7c296f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:18 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 Apr 07 06:08:18 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:18 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:18 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:19 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68" returned: 0 in 0.984s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:19 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68 Apr 07 06:08:19 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:19 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.848s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4d344-dc05-4761-bee3-714ff7d54b86]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:19 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 Apr 07 06:08:19 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:20 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0526e506-b89c-403b-b3e7-97ad2b21bf68" returned: 0 in 0.663s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-0526e506-b89c-403b-b3e7-97ad2b21bf68" released by "delete_volume" :: held 1.707s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Acquiring lock "cinder-quobyte-fb230ebb-8998-451e-9b1a-855a453cd9e5" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-fb230ebb-8998-451e-9b1a-855a453cd9e5" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb19252-9419-4743-ada7-b280928f295b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:20 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9" returned: 0 in 0.714s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:20 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:20 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:20 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 Apr 07 06:08:20 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:21 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5" returned: 0 in 0.775s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:21 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5 Apr 07 06:08:21 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:21 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.744s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:21 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7 Apr 07 06:08:21 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:21 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-fb230ebb-8998-451e-9b1a-855a453cd9e5" returned: 0 in 0.604s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "cinder-quobyte-fb230ebb-8998-451e-9b1a-855a453cd9e5" released by "delete_volume" :: held 1.419s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:21 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9.d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" returned: 0 in 0.632s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7" released by "_delete_snapshot" :: held 3.068s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_snapshot" :: held 3.094s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Created reservations ['6b3a8043-6da4-4d29-872a-54870ad7f457'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:21 devstack cinder-volume[83450]: WARNING cinder.quota [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1962677284 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1962677284, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:21 devstack cinder-volume[83450]: WARNING cinder.quota [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1962677284 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1962677284, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Created reservations ['1c3e9785-8aa4-46bf-a37e-82df1bf9da22', 'ad21f928-ddb5-422f-8bb8-480283d7ccd9', '5d130c52-1019-42c8-82a6-24c75560cec8', '8c443cb2-9024-49d5-a6d7-41de4fc1f312'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Created reservations ['c86e8bfb-66a9-4bd4-b103-902703107b5c', '3740312c-24b0-4140-8484-fae09ca5fe73', 'b9ee13fc-d2d5-4427-bdc4-e33b858061b2', 'a70ffcb8-d197-48ca-ae64-5788d523895b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:21 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Delete snapshot completed successfully. Apr 07 06:08:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-28c5af33-c549-4b07-b0c9-e84fba200e1f tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-d3b1c7fd-3736-4e39-a717-1829c1cfd4e7-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Created reservations ['273b9348-2ef4-4072-98db-2b5cc68986f7', '4c766d1a-d542-4bd4-9660-4cbcd6a34301', '72c968fb-be28-470d-b3d3-b24926f7db5c', 'f3701287-9820-41ee-9640-0a46fb12b439'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:22 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:22 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:22 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.485s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f837e5c2-fcd5-42a8-ab95-6cdfb6ff99b6 tempest-GroupsTest-355572630 None] Delete group completed successfully. Apr 07 06:08:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "cinder-f170741e-5d0f-44f8-9e61-5b6235fff6f9-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-f170741e-5d0f-44f8-9e61-5b6235fff6f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" acquired by "delete_volume" :: waited 0.035s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7471988e-6e6a-46a9-8aaa-2e36cdfa6f72]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:23 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 Apr 07 06:08:23 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:23 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9" returned: 0 in 0.633s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:23 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9 Apr 07 06:08:23 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:24 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f170741e-5d0f-44f8-9e61-5b6235fff6f9" returned: 0 in 0.635s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-quobyte-f170741e-5d0f-44f8-9e61-5b6235fff6f9" released by "delete_volume" :: held 1.324s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Created reservations ['19fc694d-8a8e-421f-9496-463ceeb843de', '5513833d-ab70-43a6-bca0-6e89ffd403e3', 'b0b4d938-f5ad-4d8a-8a57-461cc491c8ff', '11f61876-4e0d-423d-85ed-049c6047d5e5'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:24 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:24 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:25 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.702s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:25 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Deleted volume successfully. Apr 07 06:08:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6d757943-cf92-452c-b3b2-f0a5ecdcc5ae tempest-SnapshotsActionsTest-698254328 None] Lock "cinder-f170741e-5d0f-44f8-9e61-5b6235fff6f9-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Flow 'volume_create_manager' (cde2714f-4aab-4a96-b241-46e915935bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf4cb1d-8d2d-4a40-8007-dfa03517f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf4cb1d-8d2d-4a40-8007-dfa03517f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1336590086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4143233c-526c-4ac3-b38b-792b44257b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6a3ed1f164be08584c7ae97429719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:31Z,use_quota=True,user_id='b13ee063b71b46fbb2f0daf06bc9c366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d7ed4d-b655-48cf-964e-edb572acc9a5),volume_type_id=a6d7ed4d-b655-48cf-964e-edb572acc9a5)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b238d7c2-798e-44f0-905a-19548f72723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b238d7c2-798e-44f0-905a-19548f72723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ebb54d-c96b-45e8-bf2c-79b65d3f144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ebb54d-c96b-45e8-bf2c-79b65d3f144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4143233c-526c-4ac3-b38b-792b44257b7a', 'volume_name': 'volume-4143233c-526c-4ac3-b38b-792b44257b7a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53bb62f-a746-4bbe-950d-46289551c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53bb62f-a746-4bbe-950d-46289551c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d617f8-eba3-4f89-b020-dee2466de049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Volume 4143233c-526c-4ac3-b38b-792b44257b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4143233c-526c-4ac3-b38b-792b44257b7a', 'volume_size': 1} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1336590086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4143233c-526c-4ac3-b38b-792b44257b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6a3ed1f164be08584c7ae97429719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:31Z,use_quota=True,user_id='b13ee063b71b46fbb2f0daf06bc9c366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d7ed4d-b655-48cf-964e-edb572acc9a5),volume_type_id=a6d7ed4d-b655-48cf-964e-edb572acc9a5)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Creating volume 4143233c-526c-4ac3-b38b-792b44257b7a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:31 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:31 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a 1073741824 Apr 07 06:08:31 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (544a1e3f-9dbc-4865-bb27-249b6e18a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33291cc9-2100-44fa-bcf8-bc94f8bcca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33291cc9-2100-44fa-bcf8-bc94f8bcca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-219816793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e954499b-7ca1-44dc-9499-b200c9f2444a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:32Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f143125-4f06-4617-abca-7707fb5a5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f143125-4f06-4617-abca-7707fb5a5e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb5e543-ced0-41bf-91c2-480cbe7de8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb5e543-ced0-41bf-91c2-480cbe7de8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e954499b-7ca1-44dc-9499-b200c9f2444a', 'volume_name': 'volume-e954499b-7ca1-44dc-9499-b200c9f2444a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac609c6b-97fc-4a80-99be-dee4909ccc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac609c6b-97fc-4a80-99be-dee4909ccc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629b7443-3e8d-4a5b-9bc4-794f2e779214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:31 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Volume e954499b-7ca1-44dc-9499-b200c9f2444a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e954499b-7ca1-44dc-9499-b200c9f2444a', 'volume_size': 1} Apr 07 06:08:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:32 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a 1073741824" returned: 0 in 0.958s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:32 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a Apr 07 06:08:32 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:32 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a" returned: 0 in 0.662s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-219816793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e954499b-7ca1-44dc-9499-b200c9f2444a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:32Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Creating volume e954499b-7ca1-44dc-9499-b200c9f2444a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:33 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d617f8-eba3-4f89-b020-dee2466de049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4143233c-526c-4ac3-b38b-792b44257b7a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:33 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a 1073741824 Apr 07 06:08:33 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be964b5-4391-429e-81eb-1c47dbf2aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:33 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Volume volume-4143233c-526c-4ac3-b38b-792b44257b7a (4143233c-526c-4ac3-b38b-792b44257b7a): created successfully Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be964b5-4391-429e-81eb-1c47dbf2aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Flow 'volume_create_manager' (cde2714f-4aab-4a96-b241-46e915935bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a5290d28-df61-420d-94a2-1cead10825c5 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Created volume successfully. Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:33 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a 1073741824" returned: 0 in 0.849s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:33 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:33 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:33 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a Apr 07 06:08:33 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:34 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.771s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d80402af-b45d-4aa1-8b33-3a56a2c00f18 tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Retype volume completed successfully. Apr 07 06:08:34 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a" returned: 0 in 0.741s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629b7443-3e8d-4a5b-9bc4-794f2e779214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e954499b-7ca1-44dc-9499-b200c9f2444a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fc8ece-a374-46f2-b3cf-cdfd030b4618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:34 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Volume volume-e954499b-7ca1-44dc-9499-b200c9f2444a (e954499b-7ca1-44dc-9499-b200c9f2444a): created successfully Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fc8ece-a374-46f2-b3cf-cdfd030b4618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (544a1e3f-9dbc-4865-bb27-249b6e18a529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-fc4b636b-fb7d-4644-be75-a69f48653ecd tempest-VolumesTestJSON-1898787733 None] Created volume successfully. Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "cinder-4143233c-526c-4ac3-b38b-792b44257b7a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "cinder-4143233c-526c-4ac3-b38b-792b44257b7a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "cinder-quobyte-4143233c-526c-4ac3-b38b-792b44257b7a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "cinder-quobyte-4143233c-526c-4ac3-b38b-792b44257b7a" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf633c-7bb4-43d9-a152-020aea395046]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:35 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a Apr 07 06:08:35 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (ad11cc3a-2db9-4163-8d17-144a4465d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1117b50f-85d3-448e-bdec-7d45043f8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1117b50f-85d3-448e-bdec-7d45043f8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-191177098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066e715c-3645-4ce3-a354-486423364be3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:36Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c96a7d-3990-4bda-abbc-04a88646e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c96a7d-3990-4bda-abbc-04a88646e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2083b5e-6adf-4abc-8a2f-bb0cf6831032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2083b5e-6adf-4abc-8a2f-bb0cf6831032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066e715c-3645-4ce3-a354-486423364be3', 'volume_name': 'volume-066e715c-3645-4ce3-a354-486423364be3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc299f-b595-4866-9c81-9e099b3eceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc299f-b595-4866-9c81-9e099b3eceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0518d378-3c4f-464b-a5f3-99e07336a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Volume 066e715c-3645-4ce3-a354-486423364be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066e715c-3645-4ce3-a354-486423364be3', 'volume_size': 1} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-191177098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066e715c-3645-4ce3-a354-486423364be3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:36Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Creating volume 066e715c-3645-4ce3-a354-486423364be3 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:36 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:36 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 1073741824 Apr 07 06:08:36 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:36 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a" returned: 0 in 1.007s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:36 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a Apr 07 06:08:36 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:37 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 1073741824" returned: 0 in 1.078s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:37 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 Apr 07 06:08:37 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:37 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4143233c-526c-4ac3-b38b-792b44257b7a" returned: 0 in 1.038s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "cinder-quobyte-4143233c-526c-4ac3-b38b-792b44257b7a" released by "delete_volume" :: held 2.110s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:37 devstack cinder-volume[83450]: WARNING cinder.quota [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:37 devstack cinder-volume[83450]: WARNING cinder.quota [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Created reservations ['ca4d9614-8cac-488c-a5da-71cf6527bd24', '76394deb-9356-4fa6-8bc0-67d2a56c6711', 'c489f401-bc8b-4afc-b85c-b3c536413a12', '5cb54300-2e4d-4169-b6ac-c229f0bb3e27'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:37 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:37 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:38 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3" returned: 0 in 1.120s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0518d378-3c4f-464b-a5f3-99e07336a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066e715c-3645-4ce3-a354-486423364be3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0427dba5-2087-4b2e-bbed-08689c36e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:38 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Volume volume-066e715c-3645-4ce3-a354-486423364be3 (066e715c-3645-4ce3-a354-486423364be3): created successfully Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0427dba5-2087-4b2e-bbed-08689c36e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (ad11cc3a-2db9-4163-8d17-144a4465d642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ad230f62-9f2d-40d5-80e4-598b0f460648 tempest-VolumesTestJSON-1898787733 None] Created volume successfully. Apr 07 06:08:38 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.702s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Deleted volume successfully. Apr 07 06:08:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a9276ed7-1933-4f94-b55c-fa1ce7f7aa6c tempest-VolumeRetypeWithoutMigrationTest-1885489312 None] Lock "cinder-4143233c-526c-4ac3-b38b-792b44257b7a-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (660dee71-1af1-411c-b945-66a10238a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a16a14-bdbc-4e84-8949-0ca456c112af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a16a14-bdbc-4e84-8949-0ca456c112af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963204288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836d9bd-d0e7-4597-9623-cb57383e13f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:40Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78873d5-ded6-4d0e-bf20-f28718757e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78873d5-ded6-4d0e-bf20-f28718757e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b98c1e-5f89-4c3d-9809-6f1a368041a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b98c1e-5f89-4c3d-9809-6f1a368041a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b836d9bd-d0e7-4597-9623-cb57383e13f3', 'volume_name': 'volume-b836d9bd-d0e7-4597-9623-cb57383e13f3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecf9ac0-9b1e-4fe5-8f90-62dc0a60fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecf9ac0-9b1e-4fe5-8f90-62dc0a60fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8879caf5-7f7b-4584-acf3-2549adc039fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:40 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Volume b836d9bd-d0e7-4597-9623-cb57383e13f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b836d9bd-d0e7-4597-9623-cb57383e13f3', 'volume_size': 1} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963204288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836d9bd-d0e7-4597-9623-cb57383e13f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='054cdc9ca27a44a193e7b1db9c8d2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:40Z,use_quota=True,user_id='6f81661bf63240e9be23f45c2b147a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Creating volume b836d9bd-d0e7-4597-9623-cb57383e13f3 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:40 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:40 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 1073741824 Apr 07 06:08:40 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:41 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 1073741824" returned: 0 in 0.963s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:41 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 Apr 07 06:08:41 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:41 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3" returned: 0 in 0.730s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8879caf5-7f7b-4584-acf3-2549adc039fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b836d9bd-d0e7-4597-9623-cb57383e13f3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6e6af2-a5ec-4d51-8fec-e0aff04be6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Volume volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 (b836d9bd-d0e7-4597-9623-cb57383e13f3): created successfully Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6e6af2-a5ec-4d51-8fec-e0aff04be6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Flow 'volume_create_manager' (660dee71-1af1-411c-b945-66a10238a951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e3bda2bd-9650-413c-b70d-348798da4c31 tempest-VolumesTestJSON-1898787733 None] Created volume successfully. Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-b836d9bd-d0e7-4597-9623-cb57383e13f3-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-b836d9bd-d0e7-4597-9623-cb57383e13f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=110,cinder:DELETE=6,cinder:UPDATE=105,cinder:INSERT=34 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:DELETE=8,cinder:SELECT=89,cinder:UPDATE=117,cinder:INSERT=16 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-quobyte-b836d9bd-d0e7-4597-9623-cb57383e13f3" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-b836d9bd-d0e7-4597-9623-cb57383e13f3" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6ce614-46a9-40eb-90a5-950c0b99dfcb]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:43 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 Apr 07 06:08:43 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:44 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3" returned: 0 in 1.046s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:44 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3 Apr 07 06:08:44 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:45 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b836d9bd-d0e7-4597-9623-cb57383e13f3" returned: 0 in 0.553s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-b836d9bd-d0e7-4597-9623-cb57383e13f3" released by "delete_volume" :: held 1.641s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Created reservations ['e2caa615-0787-486e-b3af-3652620f5907', '5f27a575-d922-4a2e-a882-48f794123585', '84e6affd-a0ef-445d-8985-5b64a092977d', '622a840e-a385-431e-8e01-d0bbd2b52265'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:45 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:45 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-066e715c-3645-4ce3-a354-486423364be3-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "cinder-066e715c-3645-4ce3-a354-486423364be3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-quobyte-066e715c-3645-4ce3-a354-486423364be3" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-066e715c-3645-4ce3-a354-486423364be3" acquired by "delete_volume" :: waited 0.028s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4f2859-39c7-4552-98e5-7316f0d73639]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:46 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 Apr 07 06:08:46 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:46 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:46 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:46 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.180s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Deleted volume successfully. Apr 07 06:08:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b9d5e986-5908-441e-9b3b-4770fdf661c5 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-b836d9bd-d0e7-4597-9623-cb57383e13f3-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:47 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3" returned: 0 in 1.445s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:47 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3 Apr 07 06:08:47 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:47 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.474s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Flow 'volume_create_manager' (a96f995b-9aae-4bb6-810c-190223f5bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8feae4-d54f-4c14-8689-e9c7befe7bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8feae4-d54f-4c14-8689-e9c7befe7bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1264133733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0238be92-5776-423b-8bfe-3a5c8f6e881f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5610f5eed4b87b1621870ba019b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:48Z,use_quota=True,user_id='8c46ac0dad7f45f086325bd058b7578a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f4ef2f-27d6-45db-b0f3-b7937f34a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f4ef2f-27d6-45db-b0f3-b7937f34a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de3a159-8953-4b4b-8a87-06b1676101dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de3a159-8953-4b4b-8a87-06b1676101dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0238be92-5776-423b-8bfe-3a5c8f6e881f', 'volume_name': 'volume-0238be92-5776-423b-8bfe-3a5c8f6e881f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60ee5bb-a047-42ac-b6cd-9fd689293cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60ee5bb-a047-42ac-b6cd-9fd689293cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7243270-6fed-4e6c-a4ca-683597542ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:47 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Volume 0238be92-5776-423b-8bfe-3a5c8f6e881f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0238be92-5776-423b-8bfe-3a5c8f6e881f', 'volume_size': 1} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1264133733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0238be92-5776-423b-8bfe-3a5c8f6e881f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5610f5eed4b87b1621870ba019b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:48Z,use_quota=True,user_id='8c46ac0dad7f45f086325bd058b7578a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Creating volume 0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:48 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:48 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f 1073741824 Apr 07 06:08:48 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:48 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-066e715c-3645-4ce3-a354-486423364be3" returned: 0 in 1.019s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-066e715c-3645-4ce3-a354-486423364be3" released by "delete_volume" :: held 2.521s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Created reservations ['c409abaa-51f0-4f66-ad20-eb3be0e748d1', '6e468b70-fb5e-44b3-93c2-f44b5e2b3fac', '9ef29dd9-5725-4533-a91a-6338ca36930b', '83e12962-b0dc-416c-9da0-dface2a9a925'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:48 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:48 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Flow 'volume_create_manager' (22d485b6-aa53-4bd9-adbe-fc53c696fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c016de-31dc-4014-89ed-bc39b25594c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-e954499b-7ca1-44dc-9499-b200c9f2444a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c016de-31dc-4014-89ed-bc39b25594c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d969d68-dc9a-496b-865b-c66b13ebe835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0e57567d244af59f9f98814c5ccf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:49Z,use_quota=True,user_id='69d929bb4abf40158bc01d609bd7ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daf5ff2-3338-407a-8962-38d8e09e89f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daf5ff2-3338-407a-8962-38d8e09e89f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42656d73-16d1-4ad6-afef-14595a3f7204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.image.glance [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Creating Keystone auth plugin from conf {{(pid=83450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-e954499b-7ca1-44dc-9499-b200c9f2444a-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "cinder-quobyte-e954499b-7ca1-44dc-9499-b200c9f2444a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:49 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f 1073741824" returned: 0 in 1.676s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-e954499b-7ca1-44dc-9499-b200c9f2444a" acquired by "delete_volume" :: waited 0.052s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[91592d8f-1711-4778-956c-bb777283458b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:49 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.238s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Deleted volume successfully. Apr 07 06:08:49 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f Apr 07 06:08:49 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-04c3d5f9-8c48-4b51-8569-5ed1514a411e tempest-VolumesTestJSON-1898787733 None] Lock "cinder-066e715c-3645-4ce3-a354-486423364be3-delete_volume" released by "delete_volume" :: held 4.214s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:50 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a Apr 07 06:08:50 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:50 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f" returned: 0 in 1.077s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] <== create_volume: return (2916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.920s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7243270-6fed-4e6c-a4ca-683597542ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0238be92-5776-423b-8bfe-3a5c8f6e881f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c955cf31-298a-44e4-86a3-8c743deffb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Volume volume-0238be92-5776-423b-8bfe-3a5c8f6e881f (0238be92-5776-423b-8bfe-3a5c8f6e881f): created successfully Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c955cf31-298a-44e4-86a3-8c743deffb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Flow 'volume_create_manager' (a96f995b-9aae-4bb6-810c-190223f5bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5134a954-9608-4ac8-ad13-1a06f0f63076 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Created volume successfully. Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42656d73-16d1-4ad6-afef-14595a3f7204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d969d68-dc9a-496b-865b-c66b13ebe835', 'volume_name': 'volume-5d969d68-dc9a-496b-865b-c66b13ebe835', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de426d-b13c-4871-b23a-7daf81cd865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de426d-b13c-4871-b23a-7daf81cd865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960dce1a-fb7d-4387-9f63-e81a48f914a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume 5d969d68-dc9a-496b-865b-c66b13ebe835: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d969d68-dc9a-496b-865b-c66b13ebe835', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Trying to clone 5d969d68-dc9a-496b-865b-c66b13ebe835 from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]). {{(pid=83450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:08:51 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a" returned: 0 in 1.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a Apr 07 06:08:51 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:08:51 devstack cinder-volume[83450]: INFO cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c07b2de-02aa-471a-be91-37a592542872]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD Apr 07 06:08:51 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:52 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e954499b-7ca1-44dc-9499-b200c9f2444a" returned: 0 in 0.810s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-quobyte-e954499b-7ca1-44dc-9499-b200c9f2444a" released by "delete_volume" :: held 2.352s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Created reservations ['c44cd4c6-0877-4d2e-8610-0d8bef00161e', 'dc27973b-4063-4b4d-ae66-92c96b6da745', '716cb63d-fd26-4c33-be8a-ed11736fed81', '9de6f287-55c1-401a-8471-118ad5c329c3'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:52 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:08:52 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:52 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD" returned: 0 in 0.977s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc is fetched for user 69d929bb4abf40158bc01d609bd7ca9e. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Creating offline snapshot 7a788780-1090-4aa8-a832-d13b8456e853 of volume 0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b60df-c769-45db-84b6-bfc1f4a3ded2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706245f-5eab-40ef-bf8f-5e1edf00ec28]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:52 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f Apr 07 06:08:52 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:52 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD Apr 07 06:08:52 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:53 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.055s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Deleted volume successfully. Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ecfeb380-76fa-460c-ae17-e3ede7314b37 tempest-VolumesTestJSON-1898787733 None] Lock "cinder-e954499b-7ca1-44dc-9499-b200c9f2444a-delete_volume" released by "delete_volume" :: held 3.885s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:53 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f" returned: 0 in 1.146s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:53 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 1G Apr 07 06:08:53 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:53 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD" returned: 0 in 1.259s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:54 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 1G" returned: 0 in 1.005s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238be92-5776-423b-8bfe-3a5c8f6e881f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:54 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238be92-5776-423b-8bfe-3a5c8f6e881f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 Apr 07 06:08:54 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:55 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238be92-5776-423b-8bfe-3a5c8f6e881f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853" returned: 0 in 0.754s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:55 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 is being set with open permissions: ugo+rw Apr 07 06:08:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:55 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 Apr 07 06:08:55 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:56 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853" returned: 0 in 0.931s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:56 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info Apr 07 06:08:56 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:57 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info" returned: 0 in 0.744s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:57 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info is being set with open permissions: ugo+rw Apr 07 06:08:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:57 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info Apr 07 06:08:57 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:58 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.info" returned: 0 in 0.857s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.602s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.157s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d969d68-dc9a-496b-865b-c66b13ebe835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0e57567d244af59f9f98814c5ccf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:49Z,use_quota=True,user_id='69d929bb4abf40158bc01d609bd7ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Creating volume 5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:58 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:08:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:58 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1073741824 Apr 07 06:08:58 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5f59c26a-e3ce-4329-b1a2-8ab220fcf1cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Create snapshot completed successfully Apr 07 06:08:59 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1073741824" returned: 0 in 1.127s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:59 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:08:59 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "cinder-7a788780-1090-4aa8-a832-d13b8456e853-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-7a788780-1090-4aa8-a832-d13b8456e853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "cinder-quobyte-7a788780-1090-4aa8-a832-d13b8456e853" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-7a788780-1090-4aa8-a832-d13b8456e853" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Deleting offline snapshot 7a788780-1090-4aa8-a832-d13b8456e853 of volume 0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] snapshot_file for this snap is: volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42277927-1e11-413e-a18d-8a4e9947554d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:59 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 Apr 07 06:08:59 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:00 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 1.090s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Attempting download of 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume 5d969d68-dc9a-496b-865b-c66b13ebe835. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd41e6bc-a0e7-4578-9dfe-8ac32d268215]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:00 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853" returned: 0 in 0.904s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0238be92-5776-423b-8bfe-3a5c8f6e881f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:00 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p Apr 07 06:09:00 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[767da2f2-9595-4e7f-867a-84a6597b0299]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:01 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f Apr 07 06:09:01 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:01 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p" returned: 0 in 1.102s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:01 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p Apr 07 06:09:01 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:01 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f" returned: 0 in 1.071s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:01 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 Apr 07 06:09:01 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Flow 'volume_create_manager' (83a21885-91e1-4bf2-b0f1-d51c47ca4d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e4ce9-a8fe-4890-ae16-03b54803a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e4ce9-a8fe-4890-ae16-03b54803a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-848792828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43196f30-abd9-465d-bf90-7088cbc797c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69ac8bcf614249aabe955d27fd05df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:02Z,use_quota=True,user_id='c0b94de6547045b2b31fcb29acedaa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4aa3a-0a25-4084-81d0-159756141614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4aa3a-0a25-4084-81d0-159756141614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58883bc-5170-4fc8-b10c-74d6dd89a95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58883bc-5170-4fc8-b10c-74d6dd89a95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43196f30-abd9-465d-bf90-7088cbc797c8', 'volume_name': 'volume-43196f30-abd9-465d-bf90-7088cbc797c8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7489b31c-410d-414a-bf32-525416e468d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7489b31c-410d-414a-bf32-525416e468d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195782ba-5ca1-4b18-b10e-634cd2e0e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:02 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Volume 43196f30-abd9-465d-bf90-7088cbc797c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43196f30-abd9-465d-bf90-7088cbc797c8', 'volume_size': 1} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-848792828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43196f30-abd9-465d-bf90-7088cbc797c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69ac8bcf614249aabe955d27fd05df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:02Z,use_quota=True,user_id='c0b94de6547045b2b31fcb29acedaa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Creating volume 43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:02 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:02 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 1073741824 Apr 07 06:09:02 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:02 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p" returned: 1 in 0.880s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_t_9bfj1p' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6037c835-ba1c-4311-8ac8-79545083d4a8]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:02 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD Apr 07 06:09:02 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:03 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853" returned: 0 in 1.183s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:03 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853 Apr 07 06:09:03 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:03 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 1073741824" returned: 0 in 1.004s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:03 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] 3faa4fff-5dff-4870-8eaf-1bcce5af47fc was qcow2, converting to raw {{(pid=83450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:03 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:03 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:03 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 Apr 07 06:09:03 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:04 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f.7a788780-1090-4aa8-a832-d13b8456e853" returned: 0 in 0.985s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-7a788780-1090-4aa8-a832-d13b8456e853" released by "_delete_snapshot" :: held 4.273s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" released by "delete_snapshot" :: held 4.320s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Created reservations ['e2ca6108-521f-4b67-bcbe-00b7f3c64e7e', 'a8bf43d5-871c-4e14-9d0b-d0a156111d25', '10582790-cd12-48cd-bbb3-20014388db03', '1eaeac1f-3c8f-4085-95f9-32e8b6998822'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Delete snapshot completed successfully. Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06b6a549-bdd2-4b71-9aa6-220e21c1bb79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-7a788780-1090-4aa8-a832-d13b8456e853-delete_snapshot" released by "delete_snapshot" :: held 4.614s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:04 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8" returned: 0 in 1.103s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195782ba-5ca1-4b18-b10e-634cd2e0e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43196f30-abd9-465d-bf90-7088cbc797c8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe25ed7-913b-4898-aa5d-ace4ac93decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:04 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Volume volume-43196f30-abd9-465d-bf90-7088cbc797c8 (43196f30-abd9-465d-bf90-7088cbc797c8): created successfully Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe25ed7-913b-4898-aa5d-ace4ac93decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Flow 'volume_create_manager' (83a21885-91e1-4bf2-b0f1-d51c47ca4d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e3cee104-595e-48a1-ad7b-0b6978df575f tempest-SnapshotMetadataTestJSON-1189582728 None] Created volume successfully. Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "cinder-0238be92-5776-423b-8bfe-3a5c8f6e881f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-0238be92-5776-423b-8bfe-3a5c8f6e881f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" acquired by "delete_volume" :: waited 0.065s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:05 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa569c3-c37b-4756-b599-3b1be6c80ac0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 2.405s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Creating offline snapshot bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 of volume 43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8hejyc_gdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:09:05 devstack cinder-volume[83450]: INFO cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Converted 112.00 MB image at 45.98 MB/s Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[58705a3a-4e21-4a59-8080-affcd24bf987]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:05 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1G Apr 07 06:09:05 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f Apr 07 06:09:05 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:05 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 Apr 07 06:09:05 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:06 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f" returned: 0 in 0.869s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:06 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 1G" returned: 0 in 0.839s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:06 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f Apr 07 06:09:06 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[94708bee-21e5-455f-8a83-2f2df354b25a]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:06 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:06 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:06 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8" returned: 0 in 1.175s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:06 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 1G Apr 07 06:09:06 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:07 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0238be92-5776-423b-8bfe-3a5c8f6e881f" returned: 0 in 0.733s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-quobyte-0238be92-5776-423b-8bfe-3a5c8f6e881f" released by "delete_volume" :: held 1.688s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Created reservations ['98478d67-cee2-4eb1-83f6-a04b9ea0eb16', '61be3bf4-b73a-41ed-b9fb-9c6a586e8241', '9ddd508c-2630-4a7b-97af-279fb67defbe', '3616c01d-a450-46db-a847-c15651597d84'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:07 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 0.839s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:07 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:07 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:07 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:07 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:07 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 1G" returned: 0 in 0.674s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43196f30-abd9-465d-bf90-7088cbc797c8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:07 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43196f30-abd9-465d-bf90-7088cbc797c8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 Apr 07 06:09:07 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:08 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 1 in 0.852s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Downloaded image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume 5d969d68-dc9a-496b-865b-c66b13ebe835 successfully. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc for user 69d929bb4abf40158bc01d609bd7ca9e is deleted. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Marking volume 5d969d68-dc9a-496b-865b-c66b13ebe835 as bootable. {{(pid=83450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Copying metadata from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc to 5d969d68-dc9a-496b-865b-c66b13ebe835. {{(pid=83450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Creating volume glance metadata for volume 5d969d68-dc9a-496b-865b-c66b13ebe835 backed by image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:09:08 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43196f30-abd9-465d-bf90-7088cbc797c8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" returned: 0 in 0.818s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:08 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 is being set with open permissions: ugo+rw Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:08 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960dce1a-fb7d-4387-9f63-e81a48f914a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d969d68-dc9a-496b-865b-c66b13ebe835', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755b046-7df2-4282-9a70-5013cd70bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.027s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:08 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 Apr 07 06:09:08 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Deleted volume successfully. Apr 07 06:09:08 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Volume volume-5d969d68-dc9a-496b-865b-c66b13ebe835 (5d969d68-dc9a-496b-865b-c66b13ebe835): created successfully Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755b046-7df2-4282-9a70-5013cd70bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Flow 'volume_create_manager' (22d485b6-aa53-4bd9-adbe-fc53c696fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-e847839a-fb29-4ea1-995a-30c0831987d0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Created volume successfully. Apr 07 06:09:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4c556033-00bc-40c2-887e-2e6350aa8ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1951828968 None] Lock "cinder-0238be92-5776-423b-8bfe-3a5c8f6e881f-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:09 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" returned: 0 in 0.653s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:09 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info Apr 07 06:09:09 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:09 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info" returned: 0 in 0.689s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:09 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info is being set with open permissions: ugo+rw Apr 07 06:09:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:09 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info Apr 07 06:09:09 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:10 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.info" returned: 0 in 0.666s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.922s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:10 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c27e1309-3040-4706-9b08-1737dc7f8712 tempest-SnapshotMetadataTestJSON-1189582728 None] Create snapshot completed successfully Apr 07 06:09:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e1a42f-ddd6-490b-bb0a-b50d0064d45d]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:11 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:11 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "cinder-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "cinder-quobyte-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Deleting offline snapshot bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 of volume 43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] snapshot_file for this snap is: volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8315d8-afc2-4ee4-9f50-4d901c2fcf19]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:12 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 0.755s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:12 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 Apr 07 06:09:12 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:12 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:12 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:13 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:13 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 1 in 0.701s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.496s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" returned: 0 in 0.790s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43196f30-abd9-465d-bf90-7088cbc797c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa76596-8cfb-4ece-9076-21decfc6e309]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9', 'name': 'volume-5d969d68-dc9a-496b-865b-c66b13ebe835', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94171372-f63a-4775-b5cc-d2d1ede789dc', 'enforce_multipath': True} {{(pid=83450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:09:13 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-518258ba-b174-471c-a4a8-a29e51651cee req-62692e74-ed0c-498f-9689-e2b6e10f8d72 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] attachment_update completed successfully. Apr 07 06:09:13 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 Apr 07 06:09:13 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:14 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8" returned: 0 in 0.888s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:14 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 Apr 07 06:09:14 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:15 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" returned: 0 in 1.008s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:15 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37 Apr 07 06:09:15 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:15 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8.bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" returned: 0 in 0.667s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37" released by "_delete_snapshot" :: held 3.456s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" released by "delete_snapshot" :: held 3.476s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:15 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Created reservations ['1def6cde-03c0-4065-9ca4-ac049aa4e9c0', '546f32ed-6869-4c71-b6c3-cdf3d2c727d8', '63f2bb76-8a42-4d9d-bb24-1097bf83be67', '292f587f-dbdf-4c2c-9414-c6ed58fc353a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Delete snapshot completed successfully. Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-92b88b68-25f1-466f-9b02-bb429aa90446 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-bd72d7d4-bc7e-4d50-a1a4-d9b5f798df37-delete_snapshot" released by "delete_snapshot" :: held 3.662s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "cinder-43196f30-abd9-465d-bf90-7088cbc797c8-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-43196f30-abd9-465d-bf90-7088cbc797c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" acquired by "delete_volume" :: waited 0.023s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[771851db-663b-4d51-80d5-0c0310b0f73d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:16 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 Apr 07 06:09:16 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:17 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8" returned: 0 in 0.873s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:17 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8 Apr 07 06:09:17 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:18 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-43196f30-abd9-465d-bf90-7088cbc797c8" returned: 0 in 1.023s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-quobyte-43196f30-abd9-465d-bf90-7088cbc797c8" released by "delete_volume" :: held 1.976s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:18 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Created reservations ['2212319e-87e8-4dca-ace2-8293b9a28b3f', 'd379e0e9-cff7-480e-93d8-8d8665ef271a', '9ad6c7e6-8863-41c9-84de-8c9202e470e8', 'ae6e7c79-3a7b-47ea-a59f-eb0ecce54792'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:19 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:19 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:20 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.055s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:20 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Deleted volume successfully. Apr 07 06:09:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-503522bd-b93e-4021-abdf-28d442e8d026 tempest-SnapshotMetadataTestJSON-1189582728 None] Lock "cinder-43196f30-abd9-465d-bf90-7088cbc797c8-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:27 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Flow 'volume_create_manager' (518b2448-cfb3-46ee-8210-7485d9619133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073696e-0ba6-483f-8e5b-b815e27f0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073696e-0ba6-483f-8e5b-b815e27f0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1597711307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41153aed-eedb-425b-901c-19ff088d6dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bba601f559b486dbfb548448278362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:28Z,use_quota=True,user_id='bd215b530cd14dca8acca529801ad505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea31fbc5-1110-4b83-b1d0-79b18ef84c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea31fbc5-1110-4b83-b1d0-79b18ef84c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1484a15-966f-4ae7-ad20-8e60d1af5e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1484a15-966f-4ae7-ad20-8e60d1af5e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41153aed-eedb-425b-901c-19ff088d6dc6', 'volume_name': 'volume-41153aed-eedb-425b-901c-19ff088d6dc6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c31213-fea8-4756-a2cd-f3a6c0d7d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c31213-fea8-4756-a2cd-f3a6c0d7d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c387ed3-0c28-4b3f-9a65-e1f5ec79014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:28 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Volume 41153aed-eedb-425b-901c-19ff088d6dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41153aed-eedb-425b-901c-19ff088d6dc6', 'volume_size': 1} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1597711307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41153aed-eedb-425b-901c-19ff088d6dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bba601f559b486dbfb548448278362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:28Z,use_quota=True,user_id='bd215b530cd14dca8acca529801ad505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Creating volume 41153aed-eedb-425b-901c-19ff088d6dc6 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:28 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:28 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 1073741824 Apr 07 06:09:28 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:29 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 1073741824" returned: 0 in 1.088s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:29 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 Apr 07 06:09:29 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:29 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6" returned: 0 in 0.588s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c387ed3-0c28-4b3f-9a65-e1f5ec79014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41153aed-eedb-425b-901c-19ff088d6dc6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03031f4-1dcf-4557-acff-01e24e6eeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:29 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Volume volume-41153aed-eedb-425b-901c-19ff088d6dc6 (41153aed-eedb-425b-901c-19ff088d6dc6): created successfully Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03031f4-1dcf-4557-acff-01e24e6eeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Flow 'volume_create_manager' (518b2448-cfb3-46ee-8210-7485d9619133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a91316be-c285-4ef8-b7eb-878d39c133dc tempest-VolumesMetadataTest-947427906 None] Created volume successfully. Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Flow 'volume_create_manager' (d5f09c39-7445-4964-82b9-b9d31f6846ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5be7dab-6a55-4586-acc2-6c810d516853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5be7dab-6a55-4586-acc2-6c810d516853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-438286194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1321efde-bb3d-4906-81bd-70b5bfef1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7424c4b56993492fa95f5b4a91672ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:30Z,use_quota=True,user_id='a6333be62e914430ac223766dc4eb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a160a79d-f351-49ad-bda8-5094287942a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a160a79d-f351-49ad-bda8-5094287942a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577fece-fe53-4da1-8e8e-12a0e137e833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:29 devstack cinder-volume[83450]: DEBUG cinder.image.glance [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Creating Keystone auth plugin from conf {{(pid=83450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577fece-fe53-4da1-8e8e-12a0e137e833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1321efde-bb3d-4906-81bd-70b5bfef1f7e', 'volume_name': 'volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0dcd07a-4172-46de-a652-7253d8a1c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0dcd07a-4172-46de-a652-7253d8a1c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a18fdc-0324-43e6-8dff-9ede309ee19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:30 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Trying to clone 1321efde-bb3d-4906-81bd-70b5bfef1f7e from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]). {{(pid=83450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:09:30 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e14b67-141e-4ae2-959d-1db5fecde5bf]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD Apr 07 06:09:31 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Acquiring lock "cinder-41153aed-eedb-425b-901c-19ff088d6dc6-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "cinder-41153aed-eedb-425b-901c-19ff088d6dc6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Acquiring lock "cinder-quobyte-41153aed-eedb-425b-901c-19ff088d6dc6" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "cinder-quobyte-41153aed-eedb-425b-901c-19ff088d6dc6" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d23a8-2724-41f7-939c-2dce35005c0b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 Apr 07 06:09:31 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD" returned: 0 in 0.679s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc is fetched for user a6333be62e914430ac223766dc4eb48c. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f8fcf-4bd1-4f72-a7a0-4f243c1d9e6f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD Apr 07 06:09:31 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:32 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6" returned: 0 in 0.670s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6 Apr 07 06:09:32 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:32 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-438286194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1321efde-bb3d-4906-81bd-70b5bfef1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7424c4b56993492fa95f5b4a91672ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:30Z,use_quota=True,user_id='a6333be62e914430ac223766dc4eb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Creating volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:32 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1073741824 Apr 07 06:09:32 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:32 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-41153aed-eedb-425b-901c-19ff088d6dc6" returned: 0 in 0.667s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "cinder-quobyte-41153aed-eedb-425b-901c-19ff088d6dc6" released by "delete_volume" :: held 1.368s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Created reservations ['230db393-aa7f-469d-a553-ba8a1c277678', 'bbf695b9-c0dc-41de-b100-f1f95c9b878f', 'a8e81dad-b264-414a-9ffc-29c4e34d52ef', 'd5e3a95b-b24e-4809-bd43-8db2f76779cb'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:32 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:33 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1073741824" returned: 0 in 0.703s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:33 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:33 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:33 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 0 in 0.617s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:33 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.806s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Deleted volume successfully. Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Attempting download of 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-288c0f40-6bce-45d3-953a-7f26b137a822 tempest-VolumesMetadataTest-947427906 None] Lock "cinder-41153aed-eedb-425b-901c-19ff088d6dc6-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[717dd919-7413-4646-a480-bb50119e03a0]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:33 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr Apr 07 06:09:33 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:34 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr" returned: 0 in 0.797s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:34 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr Apr 07 06:09:34 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:35 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr" returned: 1 in 0.720s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_8564jbhr' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170ff48-c8a3-47f8-809f-3d7a89a40925]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD Apr 07 06:09:35 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:36 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD" returned: 0 in 1.276s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:36 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] 3faa4fff-5dff-4870-8eaf-1bcce5af47fc was qcow2, converting to raw {{(pid=83450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:09:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:36 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:36 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:38 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 0 in 2.059s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:38 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tf3iztu0devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:09:38 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Converted 112.00 MB image at 54.36 MB/s Apr 07 06:09:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:38 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1G Apr 07 06:09:38 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Flow 'volume_create_manager' (2d751572-9c26-468b-9e68-53c521f17dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3105eaaf-b1c4-4014-9b7c-1992ee7f53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3105eaaf-b1c4-4014-9b7c-1992ee7f53cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-400648210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f038e88e-c603-4bea-a79e-20930a612316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf27ec904cab4755a50dd3c471681b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:39Z,use_quota=True,user_id='c235429abbcc4f2bba0f20f885d90416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc346a9-b91b-4b32-84e6-39ab2e075351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc346a9-b91b-4b32-84e6-39ab2e075351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2535cba-1a84-47cb-9492-ed96bf91429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2535cba-1a84-47cb-9492-ed96bf91429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f038e88e-c603-4bea-a79e-20930a612316', 'volume_name': 'volume-f038e88e-c603-4bea-a79e-20930a612316', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a832ff-a6c4-4404-9914-a9e594ab82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a832ff-a6c4-4404-9914-a9e594ab82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4c5e69-02ec-454d-bdfa-20b0155050e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Volume f038e88e-c603-4bea-a79e-20930a612316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f038e88e-c603-4bea-a79e-20930a612316', 'volume_size': 1} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-400648210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f038e88e-c603-4bea-a79e-20930a612316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf27ec904cab4755a50dd3c471681b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:39Z,use_quota=True,user_id='c235429abbcc4f2bba0f20f885d90416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Creating volume f038e88e-c603-4bea-a79e-20930a612316 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:39 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:39 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 1073741824 Apr 07 06:09:39 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:39 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e 1G" returned: 0 in 0.807s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[248bad41-0203-4039-bb00-f16548daff6c]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:39 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:39 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:40 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 1073741824" returned: 0 in 0.948s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:40 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 Apr 07 06:09:40 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:40 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 0 in 1.403s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:41 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:41 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:41 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316" returned: 0 in 0.809s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4c5e69-02ec-454d-bdfa-20b0155050e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f038e88e-c603-4bea-a79e-20930a612316', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b164362-28da-4ea8-a62b-c3a49a2d644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Volume volume-f038e88e-c603-4bea-a79e-20930a612316 (f038e88e-c603-4bea-a79e-20930a612316): created successfully Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b164362-28da-4ea8-a62b-c3a49a2d644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Flow 'volume_create_manager' (2d751572-9c26-468b-9e68-53c521f17dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:41 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-db6425c4-7ab3-41cb-8d44-27a89aa68695 tempest-VolumesTransfersV355Test-259354458 None] Created volume successfully. Apr 07 06:09:41 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 1 in 0.934s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Downloaded image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e successfully. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc for user a6333be62e914430ac223766dc4eb48c is deleted. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Marking volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e as bootable. {{(pid=83450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Copying metadata from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc to 1321efde-bb3d-4906-81bd-70b5bfef1f7e. {{(pid=83450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:09:41 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Creating volume glance metadata for volume 1321efde-bb3d-4906-81bd-70b5bfef1f7e backed by image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:09:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a18fdc-0324-43e6-8dff-9ede309ee19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689fd16-c2c1-49cd-8209-3be0c8f1deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Volume volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e (1321efde-bb3d-4906-81bd-70b5bfef1f7e): created successfully Apr 07 06:09:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689fd16-c2c1-49cd-8209-3be0c8f1deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Flow 'volume_create_manager' (d5f09c39-7445-4964-82b9-b9d31f6846ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-14d9ad13-a71b-4ac2-91f7-40ede0143308 tempest-VolumesImageMetadata-520389520 None] Created volume successfully. Apr 07 06:09:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-17a5258e-165a-4080-90d9-c1e0ad462a85 tempest-VolumesTransfersV355Test-1283442120 None] Transfer volume completed successfully. Apr 07 06:09:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Acquiring lock "cinder-1321efde-bb3d-4906-81bd-70b5bfef1f7e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "cinder-1321efde-bb3d-4906-81bd-70b5bfef1f7e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:43 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=72,cinder:INSERT=29,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:09:43 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=91,cinder:INSERT=37,cinder:UPDATE=84,cinder:DELETE=6 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Acquiring lock "cinder-quobyte-1321efde-bb3d-4906-81bd-70b5bfef1f7e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "cinder-f038e88e-c603-4bea-a79e-20930a612316-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "cinder-quobyte-1321efde-bb3d-4906-81bd-70b5bfef1f7e" acquired by "delete_volume" :: waited 0.042s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-f038e88e-c603-4bea-a79e-20930a612316-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "cinder-quobyte-f038e88e-c603-4bea-a79e-20930a612316" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b48b2-8084-4d75-9913-dcc2c86775f5]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-quobyte-f038e88e-c603-4bea-a79e-20930a612316" acquired by "delete_volume" :: waited 0.038s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d451e15-b85c-49e0-a6fc-b691adcdad8e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:44 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 Apr 07 06:09:44 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:44 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:44 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:45 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 0 in 1.628s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:45 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316" returned: 0 in 1.627s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:45 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316 Apr 07 06:09:45 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:46 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:46 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:46 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:46 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:46 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f038e88e-c603-4bea-a79e-20930a612316" returned: 0 in 0.709s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-quobyte-f038e88e-c603-4bea-a79e-20930a612316" released by "delete_volume" :: held 2.388s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Created reservations ['acbf3dd4-9569-48f5-9b8c-bbd794754f8a', '0e285916-9924-4926-b7c6-0dc32ef4d7e0', '6c59bdaa-79a6-46a2-b144-2b3cb3b54d33', 'c90c0ef2-f555-48f2-8869-4d06893bd606'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:46 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:46 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:46 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 1 in 1.057s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:46 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e Apr 07 06:09:46 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:47 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.241s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:47 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1321efde-bb3d-4906-81bd-70b5bfef1f7e" returned: 0 in 0.775s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "cinder-quobyte-1321efde-bb3d-4906-81bd-70b5bfef1f7e" released by "delete_volume" :: held 3.586s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Created reservations ['ee91eb34-bb7f-4cd0-a631-cc71ce5856da', '31f163d3-c243-40eb-8fc6-0d5e1bdfca7b', 'cf64b4cd-1f42-444a-aca8-5078863b9f42', '18f3f53c-20d9-44df-9780-247c869ca6e8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:47 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.012s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:47 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Deleted volume successfully. Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-273aea88-9ea7-494c-b7c1-c79ca200dcb1 tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-f038e88e-c603-4bea-a79e-20930a612316-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:47 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:47 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Flow 'volume_create_manager' (4c0f46a5-425b-4538-af8c-52ff69b75abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0139068-1079-4e3a-9830-5e20914c4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0139068-1079-4e3a-9830-5e20914c4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2002990638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57165a8-79d7-4147-9273-083aa548e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf27ec904cab4755a50dd3c471681b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:48Z,use_quota=True,user_id='c235429abbcc4f2bba0f20f885d90416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc1e78f-4aa5-421c-bce3-81bb94809aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc1e78f-4aa5-421c-bce3-81bb94809aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af3f60c-8e26-46cf-8ea5-8c72ba1bcbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af3f60c-8e26-46cf-8ea5-8c72ba1bcbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57165a8-79d7-4147-9273-083aa548e97c', 'volume_name': 'volume-e57165a8-79d7-4147-9273-083aa548e97c', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9a3e85-102f-4eff-a4ae-5bf2a1a2e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9a3e85-102f-4eff-a4ae-5bf2a1a2e16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ee4a94-55e6-4bfc-a907-41dded4e9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:48 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Volume e57165a8-79d7-4147-9273-083aa548e97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57165a8-79d7-4147-9273-083aa548e97c', 'volume_size': 1} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2002990638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57165a8-79d7-4147-9273-083aa548e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf27ec904cab4755a50dd3c471681b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:48Z,use_quota=True,user_id='c235429abbcc4f2bba0f20f885d90416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Creating volume e57165a8-79d7-4147-9273-083aa548e97c {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:48 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:48 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c 1073741824 Apr 07 06:09:48 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:48 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.667s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Deleted volume successfully. Apr 07 06:09:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8fc867d3-a452-45ec-ab91-ec14f800bf2d tempest-VolumesImageMetadata-520389520 None] Lock "cinder-1321efde-bb3d-4906-81bd-70b5bfef1f7e-delete_volume" released by "delete_volume" :: held 4.676s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:49 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c 1073741824" returned: 0 in 0.681s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:49 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c Apr 07 06:09:49 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-46068638-319b-49cd-9c7e-fb1dd030443c req-fb3a9a3d-f124-4ede-9d7d-9e8ce791eab0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Terminate volume connection completed successfully. Apr 07 06:09:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-46068638-319b-49cd-9c7e-fb1dd030443c req-fb3a9a3d-f124-4ede-9d7d-9e8ce791eab0 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Deleting attachment 94171372-f63a-4775-b5cc-d2d1ede789dc. {{(pid=83450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:09:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "cinder-5d969d68-dc9a-496b-865b-c66b13ebe835-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-5d969d68-dc9a-496b-865b-c66b13ebe835-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "cinder-quobyte-5d969d68-dc9a-496b-865b-c66b13ebe835" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-quobyte-5d969d68-dc9a-496b-865b-c66b13ebe835" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17772a0-a0cf-4717-9a7e-8049cbad83a1]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:50 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c" returned: 0 in 1.033s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ee4a94-55e6-4bfc-a907-41dded4e9f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57165a8-79d7-4147-9273-083aa548e97c', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f8beca-372f-4192-bc2e-1abe9d35a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:50 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:50 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Volume volume-e57165a8-79d7-4147-9273-083aa548e97c (e57165a8-79d7-4147-9273-083aa548e97c): created successfully Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f8beca-372f-4192-bc2e-1abe9d35a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Flow 'volume_create_manager' (4c0f46a5-425b-4538-af8c-52ff69b75abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c2c71456-394b-469e-9960-333096652df8 tempest-VolumesTransfersV355Test-259354458 None] Created volume successfully. Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "cinder-e57165a8-79d7-4147-9273-083aa548e97c-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-e57165a8-79d7-4147-9273-083aa548e97c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "cinder-quobyte-e57165a8-79d7-4147-9273-083aa548e97c" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-quobyte-e57165a8-79d7-4147-9273-083aa548e97c" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa1ddeb-77f7-4c8c-9ae2-cac6746e7d50]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:51 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 1.138s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:51 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c Apr 07 06:09:51 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:51 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:51 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:51 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c" returned: 0 in 0.846s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:52 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 1 in 0.765s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:52 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c Apr 07 06:09:52 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:52 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835 Apr 07 06:09:52 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:52 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e57165a8-79d7-4147-9273-083aa548e97c" returned: 0 in 0.661s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-quobyte-e57165a8-79d7-4147-9273-083aa548e97c" released by "delete_volume" :: held 1.563s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:52 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5d969d68-dc9a-496b-865b-c66b13ebe835" returned: 0 in 0.704s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-quobyte-5d969d68-dc9a-496b-865b-c66b13ebe835" released by "delete_volume" :: held 2.664s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Created reservations ['53e3aaa1-f611-4b3d-bb43-29a3815ad72b', '150617ce-f04b-4462-a23d-b42d5923b5a5', 'a27d9387-d477-4e54-a593-b79ec6454927', '5567a292-fb3e-4c70-8921-772cd695fc3b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.quota [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Created reservations ['2e3c6ac2-5037-49da-bb78-21683216f2ab', '7c252915-8978-4c49-853a-95d1ae595ae4', '22dafab7-f5d1-4e52-bd8c-caca4e400cf2', 'e903b64e-57b4-4b5f-8dff-0ddb674eee2d'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:52 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:52 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:53 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:09:53 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:53 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.950s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Deleted volume successfully. Apr 07 06:09:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1637bf35-8b7c-4716-b13e-973916a79d0e tempest-VolumesTransfersV355Test-1642640960 None] Lock "cinder-e57165a8-79d7-4147-9273-083aa548e97c-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:54 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Flow 'volume_create_manager' (44a5d53d-c709-43ba-9a40-fb56441152b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71550773-6487-463a-ad50-86fb1f18527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.109s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.manager [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Deleted volume successfully. Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71550773-6487-463a-ad50-86fb1f18527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-409514888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca29974f-b1b4-4675-ae82-b9a72675b847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d23534a48d4c31badf37edbffa5bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:54Z,use_quota=True,user_id='9aad6cb3185a425ea0fb2251c5e7845f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672e639-6f22-46ff-b8e2-4c6471410f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672e639-6f22-46ff-b8e2-4c6471410f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070fe768-ab76-4b35-877f-9abf93f0dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070fe768-ab76-4b35-877f-9abf93f0dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca29974f-b1b4-4675-ae82-b9a72675b847', 'volume_name': 'volume-ca29974f-b1b4-4675-ae82-b9a72675b847', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40252915-74cc-4047-b857-9dc87c6034db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40252915-74cc-4047-b857-9dc87c6034db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db521ce-6cf8-4727-b25f-9c2a172fae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:54 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Volume ca29974f-b1b4-4675-ae82-b9a72675b847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca29974f-b1b4-4675-ae82-b9a72675b847', 'volume_size': 1} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-409514888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca29974f-b1b4-4675-ae82-b9a72675b847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d23534a48d4c31badf37edbffa5bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:54Z,use_quota=True,user_id='9aad6cb3185a425ea0fb2251c5e7845f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Creating volume ca29974f-b1b4-4675-ae82-b9a72675b847 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:54 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-46068638-319b-49cd-9c7e-fb1dd030443c req-04d272a3-e8db-4ff8-a5f1-b3af76906309 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-5d969d68-dc9a-496b-865b-c66b13ebe835-delete_volume" released by "delete_volume" :: held 4.321s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:54 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 1073741824 Apr 07 06:09:54 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:55 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 1073741824" returned: 0 in 1.083s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:55 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 Apr 07 06:09:55 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:56 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847" returned: 0 in 0.891s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db521ce-6cf8-4727-b25f-9c2a172fae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca29974f-b1b4-4675-ae82-b9a72675b847', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5df1235-d9c4-4b57-80e5-5500e981e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Volume volume-ca29974f-b1b4-4675-ae82-b9a72675b847 (ca29974f-b1b4-4675-ae82-b9a72675b847): created successfully Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5df1235-d9c4-4b57-80e5-5500e981e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Flow 'volume_create_manager' (44a5d53d-c709-43ba-9a40-fb56441152b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7ec1b512-ed6b-434c-bf29-58c7142a0825 tempest-VolumesTransfersV357Test-1582006832 None] Created volume successfully. Apr 07 06:09:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9ad1c135-efff-409b-b6d6-5340db50b253 tempest-VolumesTransfersV357Test-1487961466 None] Transfer volume completed successfully. Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "cinder-ca29974f-b1b4-4675-ae82-b9a72675b847-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-ca29974f-b1b4-4675-ae82-b9a72675b847-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "cinder-quobyte-ca29974f-b1b4-4675-ae82-b9a72675b847" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-quobyte-ca29974f-b1b4-4675-ae82-b9a72675b847" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca99576-7e33-4d7b-b0a2-0b3250155919]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:59 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 Apr 07 06:09:59 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:00 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847" returned: 0 in 0.798s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:00 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847 Apr 07 06:10:00 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:01 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca29974f-b1b4-4675-ae82-b9a72675b847" returned: 0 in 0.737s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-quobyte-ca29974f-b1b4-4675-ae82-b9a72675b847" released by "delete_volume" :: held 1.596s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Created reservations ['6293f37d-0973-458b-bb3b-948382cd8497', '4bee5daf-0791-4a9d-aeaf-7f0436c406f2', '1d8c359b-5462-4103-bd8e-3a47511e1007', '36fc29a9-16fb-453f-9bf8-26433eb6eb9c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:01 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:01 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:02 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.054s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Deleted volume successfully. Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-76a034a0-1ce6-4734-bac8-eba31be83218 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-ca29974f-b1b4-4675-ae82-b9a72675b847-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Flow 'volume_create_manager' (4da84c06-9f43-455f-aa74-15c64e56be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a39afe0-394c-442c-8d47-9070ec0c9f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a39afe0-394c-442c-8d47-9070ec0c9f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-325490122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a9a2a6-28cf-41b4-9e4f-f07510890372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d23534a48d4c31badf37edbffa5bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:03Z,use_quota=True,user_id='9aad6cb3185a425ea0fb2251c5e7845f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993ff8c9-ef60-4db3-8f93-61a6fa2bd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993ff8c9-ef60-4db3-8f93-61a6fa2bd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100579c4-df98-4068-a157-c52aa1de4a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100579c4-df98-4068-a157-c52aa1de4a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a9a2a6-28cf-41b4-9e4f-f07510890372', 'volume_name': 'volume-92a9a2a6-28cf-41b4-9e4f-f07510890372', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89cd692-b88f-4688-8257-1bc5ad19ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89cd692-b88f-4688-8257-1bc5ad19ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d73580-6f39-441c-8cea-a3b7125b62fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:02 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Volume 92a9a2a6-28cf-41b4-9e4f-f07510890372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a9a2a6-28cf-41b4-9e4f-f07510890372', 'volume_size': 1} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-325490122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a9a2a6-28cf-41b4-9e4f-f07510890372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d23534a48d4c31badf37edbffa5bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:03Z,use_quota=True,user_id='9aad6cb3185a425ea0fb2251c5e7845f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Creating volume 92a9a2a6-28cf-41b4-9e4f-f07510890372 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:02 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:02 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 1073741824 Apr 07 06:10:02 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:03 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 1073741824" returned: 0 in 1.024s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:03 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 Apr 07 06:10:03 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:04 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372" returned: 0 in 0.754s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d73580-6f39-441c-8cea-a3b7125b62fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a9a2a6-28cf-41b4-9e4f-f07510890372', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd6349-7291-46f3-8f53-a85572b63f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:04 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Volume volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 (92a9a2a6-28cf-41b4-9e4f-f07510890372): created successfully Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd6349-7291-46f3-8f53-a85572b63f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Flow 'volume_create_manager' (4da84c06-9f43-455f-aa74-15c64e56be1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-50971614-c74e-4ff6-93c9-db30455a5223 tempest-VolumesTransfersV357Test-1582006832 None] Created volume successfully. Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Flow 'volume_create_manager' (dd6ddeeb-3725-4256-9bb6-b5cbc6d60865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac957c89-adef-46f9-af67-d7ada758b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac957c89-adef-46f9-af67-d7ada758b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1367539235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9065fc6e2244b6ae1997e6a25dd2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:05Z,use_quota=True,user_id='61ceb3efbd7d4dbfa255d313c5b8882a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a94fa0-33e6-4a96-98a8-4b0fbbb7e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a94fa0-33e6-4a96-98a8-4b0fbbb7e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a507531-9b43-425e-ae57-bf5fab37ecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.image.glance [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Creating Keystone auth plugin from conf {{(pid=83450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a507531-9b43-425e-ae57-bf5fab37ecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2', 'volume_name': 'volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5180f64-4b3f-401c-833e-3782b8de14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5180f64-4b3f-401c-833e-3782b8de14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb89e23-c7c3-4f0a-9cc3-c72c42c83375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:05 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:10:05 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Trying to clone ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]). {{(pid=83450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:10:05 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:10:05 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:10:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b92c1-c6d5-4577-9f8c-d90dcdecc822]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:05 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD Apr 07 06:10:05 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "cinder-92a9a2a6-28cf-41b4-9e4f-f07510890372-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-92a9a2a6-28cf-41b4-9e4f-f07510890372-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:06 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc is fetched for user 61ceb3efbd7d4dbfa255d313c5b8882a. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "cinder-quobyte-92a9a2a6-28cf-41b4-9e4f-f07510890372" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-quobyte-92a9a2a6-28cf-41b4-9e4f-f07510890372" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1516fec-ccf8-4e06-bc7c-dd40fba432dd]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[84177f13-9107-4f13-ba95-8c0a9270cc34]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:06 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 Apr 07 06:10:06 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:06 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD Apr 07 06:10:06 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:06 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372" returned: 0 in 0.762s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:06 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372 Apr 07 06:10:06 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1367539235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9065fc6e2244b6ae1997e6a25dd2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:05Z,use_quota=True,user_id='61ceb3efbd7d4dbfa255d313c5b8882a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Creating volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:07 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:07 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1073741824 Apr 07 06:10:07 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-9fc6d530-3357-4b6d-8a83-c0e7ada91bda tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Terminate volume connection completed successfully. Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-9fc6d530-3357-4b6d-8a83-c0e7ada91bda tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Deleting attachment 32499895-67cd-4c87-92c4-b89d2d8cdfbf. {{(pid=83450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:10:07 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-92a9a2a6-28cf-41b4-9e4f-f07510890372" returned: 0 in 0.800s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-quobyte-92a9a2a6-28cf-41b4-9e4f-f07510890372" released by "delete_volume" :: held 1.634s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Created reservations ['fe9579a6-6882-47c8-9e9d-7f5e71089198', '72da5f20-3209-4355-93db-019a09218312', '8482e070-5c77-4d8b-9762-dec9ec561a64', 'e9ad2ae1-8179-47c3-8af2-55e9c69b3750'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:07 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1073741824" returned: 0 in 0.813s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:07 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:07 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:08 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "cinder-b28e2e06-57b1-4a05-8a72-f5624fdbc343-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-b28e2e06-57b1-4a05-8a72-f5624fdbc343-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "cinder-quobyte-b28e2e06-57b1-4a05-8a72-f5624fdbc343" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-quobyte-b28e2e06-57b1-4a05-8a72-f5624fdbc343" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fb140-b931-49f1-8968-422cafe70b6c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 Apr 07 06:10:08 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:08 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 0.810s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Attempting download of 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:10:08 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.813s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1229b056-8ba0-4cff-9da6-6f33f258c813]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Deleted volume successfully. Apr 07 06:10:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-08b419ba-97b8-4bd6-a7ea-ca88eb9e6e50 tempest-VolumesTransfersV357Test-592423122 None] Lock "cinder-92a9a2a6-28cf-41b4-9e4f-f07510890372-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:09 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z Apr 07 06:10:09 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:09 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343" returned: 0 in 1.139s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:09 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343 Apr 07 06:10:09 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:09 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z" returned: 0 in 1.112s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:10 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z Apr 07 06:10:10 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:10 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b28e2e06-57b1-4a05-8a72-f5624fdbc343" returned: 0 in 0.812s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-quobyte-b28e2e06-57b1-4a05-8a72-f5624fdbc343" released by "delete_volume" :: held 1.987s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG cinder.quota [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Created reservations ['5851a175-2480-46fe-9a71-22a2e370ffdb', 'f66dee94-1054-442f-ae8b-7021c88abb69', 'a1ed54d9-602f-46c3-8956-3515b1f00c15', 'd8d2ca22-03d3-49f2-bf7b-16578e6059bd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:10 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:10 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:11 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z" returned: 1 in 1.049s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_tarao47z' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[66adb645-ff91-42e3-a36b-4ca17dfba269]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD Apr 07 06:10:11 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:11 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.698s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG cinder.manager [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:11 devstack cinder-volume[83450]: INFO cinder.volume.manager [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Deleted volume successfully. Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [req-bcd72734-af91-42b7-92d9-c1dcd7a0db10 req-fcfdf152-e4b1-49ae-a544-3e7640834d32 tempest-ServerBootFromVolumeStableRescueTest-1742665741 None] Lock "cinder-b28e2e06-57b1-4a05-8a72-f5624fdbc343-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:11 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD" returned: 0 in 0.581s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] 3faa4fff-5dff-4870-8eaf-1bcce5af47fc was qcow2, converting to raw {{(pid=83450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:10:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:11 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:13 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 1.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_glhzyxn_devstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:10:13 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Converted 112.00 MB image at 77.75 MB/s Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:13 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1G Apr 07 06:10:13 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:13 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 1G" returned: 0 in 0.648s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930af1f-6e04-4387-860d-51c61f225917]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:13 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:13 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:14 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 0.705s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:14 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:14 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Flow 'volume_create_manager' (f68c1ba9-06a6-4831-8c36-ca20e4310718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c9cc0-85be-42e0-b96b-2511392f3df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c9cc0-85be-42e0-b96b-2511392f3df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-368594928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bc8859-a178-4c58-a247-953223752876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7f3cb1b3f94fa7a24f34f280f3802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:15Z,use_quota=True,user_id='07586277b54549e4a62e6c69db3886cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72b6460-837b-4db8-aef9-0cf1e435529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72b6460-837b-4db8-aef9-0cf1e435529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceeb080-7272-4d90-a979-a693ffe1454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceeb080-7272-4d90-a979-a693ffe1454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72bc8859-a178-4c58-a247-953223752876', 'volume_name': 'volume-72bc8859-a178-4c58-a247-953223752876', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b5f0b5-ae6a-4bdb-97a4-cb0bdc8b7c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b5f0b5-ae6a-4bdb-97a4-cb0bdc8b7c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aac65b-ad64-4a04-8875-595e724c5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:14 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Volume 72bc8859-a178-4c58-a247-953223752876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72bc8859-a178-4c58-a247-953223752876', 'volume_size': 1} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-368594928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bc8859-a178-4c58-a247-953223752876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7f3cb1b3f94fa7a24f34f280f3802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:15Z,use_quota=True,user_id='07586277b54549e4a62e6c69db3886cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Creating volume 72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:14 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 1073741824 Apr 07 06:10:14 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:15 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 1 in 0.854s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Downloaded image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 successfully. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc for user 61ceb3efbd7d4dbfa255d313c5b8882a is deleted. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Marking volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 as bootable. {{(pid=83450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Copying metadata from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc to ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2. {{(pid=83450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Creating volume glance metadata for volume ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 backed by image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb89e23-c7c3-4f0a-9cc3-c72c42c83375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9261ee5-74b1-4d13-b84d-041839ca5158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:15 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Volume volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 (ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2): created successfully Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9261ee5-74b1-4d13-b84d-041839ca5158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Flow 'volume_create_manager' (dd6ddeeb-3725-4256-9bb6-b5cbc6d60865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9ed3e66f-03bb-4b48-bb37-74fa348ecf49 tempest-VolumesExtendTest-2080380628 None] Created volume successfully. Apr 07 06:10:15 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 1073741824" returned: 0 in 1.135s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:15 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:15 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:16 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.577s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aac65b-ad64-4a04-8875-595e724c5f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72bc8859-a178-4c58-a247-953223752876', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef39bb1-5f99-4217-9bfa-5832d74bb024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:16 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Volume volume-72bc8859-a178-4c58-a247-953223752876 (72bc8859-a178-4c58-a247-953223752876): created successfully Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef39bb1-5f99-4217-9bfa-5832d74bb024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Flow 'volume_create_manager' (f68c1ba9-06a6-4831-8c36-ca20e4310718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f4de8abc-1c21-4148-a3e7-72d093eb4640 tempest-VolumesCloneTest-1664364905 None] Created volume successfully. Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7040a-cedd-4bd8-bd75-62b52573a8d6]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:17 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Flow 'volume_create_manager' (1ccfa943-2759-4187-a195-6e61d26f5767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea73fc4-8de4-4618-b193-ebdcb11f6041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea73fc4-8de4-4618-b193-ebdcb11f6041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-556743531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c35e2-0027-441f-838d-1e1ddb1533a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7f3cb1b3f94fa7a24f34f280f3802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=72bc8859-a178-4c58-a247-953223752876,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:17Z,use_quota=True,user_id='07586277b54549e4a62e6c69db3886cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960f005-9d93-433d-aaf1-a59552df49f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960f005-9d93-433d-aaf1-a59552df49f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ac571c-4a1b-4195-9815-3ef5cf0319fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ac571c-4a1b-4195-9815-3ef5cf0319fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '965c35e2-0027-441f-838d-1e1ddb1533a9', 'volume_name': 'volume-965c35e2-0027-441f-838d-1e1ddb1533a9', 'volume_size': 2, 'source_volid': '72bc8859-a178-4c58-a247-953223752876', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df6f304-78d8-46f1-bea0-d4fa8d1ddb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df6f304-78d8-46f1-bea0-d4fa8d1ddb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e5ab4c-1002-4d73-94ed-15f5b3031c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Volume 965c35e2-0027-441f-838d-1e1ddb1533a9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-965c35e2-0027-441f-838d-1e1ddb1533a9', 'volume_size': 2, 'source_volid': '72bc8859-a178-4c58-a247-953223752876', 'source_volstatus': 'available'} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:17 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 0.597s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:17 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:18 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 1 in 0.699s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 2G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 2G" returned: 0 in 0.062s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.401s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:18 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Cloning volume 72bc8859-a178-4c58-a247-953223752876 to volume 965c35e2-0027-441f-838d-1e1ddb1533a9 Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Creating offline snapshot 54e94392-e8fc-4941-8e77-b644932f856d of volume 72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dba4b2-2a4c-44e5-87f4-25aa955328c7]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6c29d682-40ff-4350-a9e2-3f5847af44d9 tempest-VolumesExtendTest-2080380628 None] Extend volume completed successfully. Apr 07 06:10:18 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:18 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:19 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.724s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:19 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d 1G Apr 07 06:10:19 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "cinder-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-quobyte-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bd84a-dd60-45ea-af14-9260daecceb5]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:19 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:19 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:19 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d 1G" returned: 0 in 0.687s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72bc8859-a178-4c58-a247-953223752876 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:19 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72bc8859-a178-4c58-a247-953223752876 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:19 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:20 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 0.712s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:20 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:20 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:20 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72bc8859-a178-4c58-a247-953223752876 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.715s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:20 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d is being set with open permissions: ugo+rw Apr 07 06:10:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:20 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:20 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:21 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 1 in 0.877s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:21 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2 Apr 07 06:10:21 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (8dd65ed9-a4de-45c9-a492-89ea4c0cfd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3392bd5-e7e7-43b6-9ea9-68154da20999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3392bd5-e7e7-43b6-9ea9-68154da20999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708660008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d53af3-7eb7-4eba-aa07-e704b7a570e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:21Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c211992f-f9fe-4b12-b3a0-f1639ede0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c211992f-f9fe-4b12-b3a0-f1639ede0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab93486f-be13-4950-bcf4-e7fb3716663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab93486f-be13-4950-bcf4-e7fb3716663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d53af3-7eb7-4eba-aa07-e704b7a570e0', 'volume_name': 'volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13344671-a430-49cf-a891-871b72dbd6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13344671-a430-49cf-a891-871b72dbd6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f01f73-4eb1-4582-86d3-fa4c6b49c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Volume 42d53af3-7eb7-4eba-aa07-e704b7a570e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0', 'volume_size': 1} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:21 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.887s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:21 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info Apr 07 06:10:21 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:21 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" returned: 0 in 0.809s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2" released by "delete_volume" :: held 2.464s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:21 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Created reservations ['5525c744-8431-4df7-b87a-ffdc234cedc8', '2add2a97-941c-4f34-b298-a74845b7a428', '18a2d1a8-e9b2-410e-89cd-5361d4093a6d', '7dd7bbb3-25cb-4718-b513-844507c86c14'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:22 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:22 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:22 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info" returned: 0 in 0.913s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:22 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info is being set with open permissions: ugo+rw Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:22 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info Apr 07 06:10:22 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:22 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.918s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:22 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Deleted volume successfully. Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-272c51e3-a6ad-4b2c-a81a-05265ed1595d tempest-VolumesExtendTest-2080380628 None] Lock "cinder-ca87b7ab-bb0d-45e5-8d8d-4c63b160b1d2-delete_volume" released by "delete_volume" :: held 3.638s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:23 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.info" returned: 0 in 0.800s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] snapshot: 54e94392-e8fc-4941-8e77-b644932f856d, volume: 965c35e2-0027-441f-838d-1e1ddb1533a9, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1491fe5-0381-4386-b50d-55a1797f5bdf]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Flow 'volume_create_manager' (4550b67f-afb9-4b9a-aff6-158ba3f80a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2540d8b3-1a3b-4b8a-a4d3-85dcc8de4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2540d8b3-1a3b-4b8a-a4d3-85dcc8de4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1789265790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163f7957-8e81-4fc4-b962-ce4457c209b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9065fc6e2244b6ae1997e6a25dd2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:23Z,use_quota=True,user_id='61ceb3efbd7d4dbfa255d313c5b8882a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197424c-4a67-4bc7-8b41-93e0f9bf1c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197424c-4a67-4bc7-8b41-93e0f9bf1c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ce958-b21c-45d0-887c-6a6825c5168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ce958-b21c-45d0-887c-6a6825c5168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163f7957-8e81-4fc4-b962-ce4457c209b0', 'volume_name': 'volume-163f7957-8e81-4fc4-b962-ce4457c209b0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713849d7-05c7-440e-8330-e39aa007ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713849d7-05c7-440e-8330-e39aa007ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46258cb6-cf19-43b9-84d9-c467545077ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:23 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Volume 163f7957-8e81-4fc4-b962-ce4457c209b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163f7957-8e81-4fc4-b962-ce4457c209b0', 'volume_size': 1} Apr 07 06:10:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:23 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:23 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:24 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.796s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72bc8859-a178-4c58-a247-953223752876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8bbb0-a426-4ded-80a6-df76742d2839]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:24 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:24 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:24 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.768s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:10:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:24 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 Apr 07 06:10:24 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9" returned: 0 in 3.215s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298523b-6b45-4861-8799-ae8b9a9701b6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:28 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:28 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.865s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876, size 1024.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:10:28 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Converted 1024.00 MB image at 318.34 MB/s Apr 07 06:10:28 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 is being set with open permissions: ugo+rw Apr 07 06:10:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:29 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 Apr 07 06:10:29 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:29 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9" returned: 0 in 0.614s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" released by "_copy_volume_from_snapshot" :: held 6.398s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-quobyte-54e94392-e8fc-4941-8e77-b644932f856d" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-54e94392-e8fc-4941-8e77-b644932f856d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Deleting offline snapshot 54e94392-e8fc-4941-8e77-b644932f856d of volume 72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] snapshot_file for this snap is: volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c317d4b-2045-496a-b273-faa786a9f5a5]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:29 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:29 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:30 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.711s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72bc8859-a178-4c58-a247-953223752876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[48979d2d-f826-4919-bd87-4fa6df4b81a0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:30 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:30 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:31 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.619s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:31 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:31 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:31 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.623s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:31 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d Apr 07 06:10:31 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:32 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876.54e94392-e8fc-4941-8e77-b644932f856d" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-54e94392-e8fc-4941-8e77-b644932f856d" released by "_delete_snapshot" :: held 2.566s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.879s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.029s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708660008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d53af3-7eb7-4eba-aa07-e704b7a570e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:21Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Creating volume 42d53af3-7eb7-4eba-aa07-e704b7a570e0 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:32 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e5ab4c-1002-4d73-94ed-15f5b3031c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965c35e2-0027-441f-838d-1e1ddb1533a9', 'volume_size': 2, 'source_volid': '72bc8859-a178-4c58-a247-953223752876', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b1022-a4b2-466a-b91d-0a1573dd96ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Volume volume-965c35e2-0027-441f-838d-1e1ddb1533a9 (965c35e2-0027-441f-838d-1e1ddb1533a9): created successfully Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b1022-a4b2-466a-b91d-0a1573dd96ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Flow 'volume_create_manager' (1ccfa943-2759-4187-a195-6e61d26f5767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:32 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 1073741824 Apr 07 06:10:32 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:32 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dd9783e4-46d5-4f19-a769-30ba7cc7d4a5 tempest-VolumesCloneTest-1664364905 None] Created volume successfully. Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-965c35e2-0027-441f-838d-1e1ddb1533a9-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "cinder-965c35e2-0027-441f-838d-1e1ddb1533a9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461bbb2-bde9-41b7-8d51-8ad5480ca0c6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:33 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 Apr 07 06:10:33 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:33 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 1073741824" returned: 0 in 1.098s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:33 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 Apr 07 06:10:33 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:33 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9" returned: 0 in 0.963s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9 Apr 07 06:10:34 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:34 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0" returned: 0 in 0.727s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.729s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1789265790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163f7957-8e81-4fc4-b962-ce4457c209b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9065fc6e2244b6ae1997e6a25dd2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:23Z,use_quota=True,user_id='61ceb3efbd7d4dbfa255d313c5b8882a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Creating volume 163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:34 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f01f73-4eb1-4582-86d3-fa4c6b49c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d709442d-96d3-421d-b1bf-7dd276008833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:34 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Volume volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 (42d53af3-7eb7-4eba-aa07-e704b7a570e0): created successfully Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d709442d-96d3-421d-b1bf-7dd276008833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (8dd65ed9-a4de-45c9-a492-89ea4c0cfd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:34 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 1073741824 Apr 07 06:10:34 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-47035bb8-f66e-49e2-adc9-df861f0d044e tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:10:34 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-965c35e2-0027-441f-838d-1e1ddb1533a9" returned: 0 in 0.809s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-965c35e2-0027-441f-838d-1e1ddb1533a9" released by "delete_volume" :: held 1.807s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Created reservations ['bb03b34b-255f-4b1d-b86e-f78b2d12a5e2', '39f6884d-6d0c-4ec5-93bc-3193383991e3', '8a01ad3b-7211-4b62-9072-18d6ab7c8c5f', '99870f17-fcf6-4998-9385-ef24c29ccd58'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:34 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 1073741824" returned: 0 in 0.761s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:34 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:34 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:35 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-72bc8859-a178-4c58-a247-953223752876-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "cinder-72bc8859-a178-4c58-a247-953223752876-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Acquiring lock "cinder-quobyte-72bc8859-a178-4c58-a247-953223752876" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-72bc8859-a178-4c58-a247-953223752876" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8a43e59f-e4a7-49f6-a4d7-3528ea646648 tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0" by "attach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8a43e59f-e4a7-49f6-a4d7-3528ea646648 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0" acquired by "attach_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b449f56-396f-4059-b923-78bc249cd182]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8a43e59f-e4a7-49f6-a4d7-3528ea646648 tempest-VolumesActionsTest-728014197 None] Attaching volume 42d53af3-7eb7-4eba-aa07-e704b7a570e0 to instance f0bc5acb-dcb3-4089-8c46-ae4968c4ab03 at mountpoint /dev/vdb on host None. Apr 07 06:10:35 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.915s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8a43e59f-e4a7-49f6-a4d7-3528ea646648 tempest-VolumesActionsTest-728014197 None] Attach volume completed successfully. Apr 07 06:10:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Deleted volume successfully. Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8a43e59f-e4a7-49f6-a4d7-3528ea646648 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0" released by "attach_volume" :: held 0.206s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c8169a8f-f1f7-4b72-8b52-146e837e6d1d tempest-VolumesCloneTest-1664364905 None] Lock "cinder-965c35e2-0027-441f-838d-1e1ddb1533a9-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:35 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:35 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:36 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 1.165s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46258cb6-cf19-43b9-84d9-c467545077ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163f7957-8e81-4fc4-b962-ce4457c209b0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44efa17b-894d-4b15-9a1b-d048e28fc3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Volume volume-163f7957-8e81-4fc4-b962-ce4457c209b0 (163f7957-8e81-4fc4-b962-ce4457c209b0): created successfully Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44efa17b-894d-4b15-9a1b-d048e28fc3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Flow 'volume_create_manager' (4550b67f-afb9-4b9a-aff6-158ba3f80a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-74261588-1ec4-4833-8915-ca7457549fa5 tempest-VolumesExtendTest-2080380628 None] Created volume successfully. Apr 07 06:10:36 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 1.060s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:36 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876 Apr 07 06:10:36 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Creating offline snapshot 5f8c857c-9085-49d7-9f1b-8afef7432e16 of volume 163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d3c737-31c6-4803-a0f1-26ad21a2503c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:37 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:37 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:37 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Terminate volume connection completed successfully. Apr 07 06:10:37 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-72bc8859-a178-4c58-a247-953223752876" returned: 0 in 0.683s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "cinder-quobyte-72bc8859-a178-4c58-a247-953223752876" released by "delete_volume" :: held 1.859s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Created reservations ['e16cbd2f-5a23-4f68-89cf-950e2f11f976', '8760aed9-9d78-4d68-ad30-766992b30123', 'ff878cfd-1467-4bda-a369-79b4a3dec561', '569e999a-15d2-4359-8809-5f215b0bad87'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:37 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:37 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" by "detach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:37 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 0.898s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" acquired by "detach_volume" :: waited 0.162s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:38 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 1G Apr 07 06:10:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Detaching volume 42d53af3-7eb7-4eba-aa07-e704b7a570e0 from instance f0bc5acb-dcb3-4089-8c46-ae4968c4ab03. Apr 07 06:10:38 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Detach volume completed successfully. Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee453998-9d76-4e85-a169-76f3f65c8353 tempest-VolumesActionsTest-502933474 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:38 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.958s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Deleted volume successfully. Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6448d8a5-4578-42f4-a866-1a064a334d24 tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" by "detach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2515d43e-986f-4081-bfbd-4e4cb1d1c3af tempest-VolumesCloneTest-1664364905 None] Lock "cinder-72bc8859-a178-4c58-a247-953223752876-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6448d8a5-4578-42f4-a866-1a064a334d24 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6448d8a5-4578-42f4-a866-1a064a334d24 tempest-VolumesActionsTest-728014197 None] Volume detach called, but volume not attached. Apr 07 06:10:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6448d8a5-4578-42f4-a866-1a064a334d24 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:39 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 1G" returned: 0 in 1.279s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163f7957-8e81-4fc4-b962-ce4457c209b0 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:39 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163f7957-8e81-4fc4-b962-ce4457c209b0 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 Apr 07 06:10:39 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-quobyte-42d53af3-7eb7-4eba-aa07-e704b7a570e0" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "cinder-quobyte-42d53af3-7eb7-4eba-aa07-e704b7a570e0" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320ec56-54e9-4d55-b103-0d15747d5540]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:39 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 Apr 07 06:10:39 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:40 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-163f7957-8e81-4fc4-b962-ce4457c209b0 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16" returned: 0 in 1.236s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:40 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 is being set with open permissions: ugo+rw Apr 07 06:10:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:40 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 Apr 07 06:10:40 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:40 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0" returned: 0 in 1.335s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:40 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0 Apr 07 06:10:40 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:41 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16" returned: 0 in 0.838s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:41 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info Apr 07 06:10:41 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:41 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-42d53af3-7eb7-4eba-aa07-e704b7a570e0" returned: 0 in 0.790s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "cinder-quobyte-42d53af3-7eb7-4eba-aa07-e704b7a570e0" released by "delete_volume" :: held 2.160s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Created reservations ['9b84c7e1-2344-4538-a9c4-ee62d40fc5c0', 'c0e0d5ad-ca7e-410e-b329-4970b9045bfa', 'b5fce598-95ae-4326-bc0f-bd392c672a3a', '82cf506f-6e19-43ab-82df-815c13bad0c1'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:41 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:41 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:42 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info" returned: 0 in 0.927s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:42 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info is being set with open permissions: ugo+rw Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:42 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info Apr 07 06:10:42 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:42 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.795s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Deleted volume successfully. Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5672106c-dfd1-4014-8770-c4f32c527cc1 tempest-VolumesActionsTest-728014197 None] Lock "cinder-42d53af3-7eb7-4eba-aa07-e704b7a570e0-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Flow 'volume_create_manager' (b21dea6e-be32-40df-9795-4f9ba1b978f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336e2be3-e0d5-4329-8e13-6e6981dfcccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336e2be3-e0d5-4329-8e13-6e6981dfcccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2084681182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665b04bf851449b28b459e0ef0f746c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:43Z,use_quota=True,user_id='fbf7c4469e484a89bb0f530c34e9db1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91f5b27-eb94-4c82-85c1-5032d3425638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91f5b27-eb94-4c82-85c1-5032d3425638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c01680-44e1-451d-afc8-b680f34dcf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c01680-44e1-451d-afc8-b680f34dcf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a', 'volume_name': 'volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a', 'volume_size': 2}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104b0059-0e07-43a0-aa26-f85f78a0bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104b0059-0e07-43a0-aa26-f85f78a0bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55835f33-f28c-4b5e-be10-39224aad7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Volume b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a', 'volume_size': 2} Apr 07 06:10:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:43 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.info" returned: 0 in 0.774s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.081s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2084681182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665b04bf851449b28b459e0ef0f746c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:43Z,use_quota=True,user_id='fbf7c4469e484a89bb0f530c34e9db1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Creating volume b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:43 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a 2147483648 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:43 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8d26c3a1-a4e7-4526-b1aa-17b6c2b777ca tempest-VolumesExtendTest-2080380628 None] Create snapshot completed successfully Apr 07 06:10:43 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a 2147483648 Apr 07 06:10:43 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:44 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a 2147483648" returned: 0 in 1.019s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=108,cinder:INSERT=50,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=139,cinder:SELECT=87,cinder:INSERT=20,cinder:DELETE=10 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:44 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a Apr 07 06:10:44 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:44 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" returned: 0 in 0.512s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55835f33-f28c-4b5e-be10-39224aad7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a', 'volume_size': 2}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be71fb6-3ca8-4b37-a6c2-c7ada89b96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0d92a6-cc48-4b62-87eb-c11fdc57ef9b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:44 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Volume volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a (b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a): created successfully Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be71fb6-3ca8-4b37-a6c2-c7ada89b96a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Flow 'volume_create_manager' (b21dea6e-be32-40df-9795-4f9ba1b978f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9884b32a-06dc-4959-8c25-e5de8f6b5672 tempest-VolumesCloneNegativeTest-963700272 None] Created volume successfully. Apr 07 06:10:44 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:44 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Acquiring lock "cinder-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "cinder-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Acquiring lock "cinder-quobyte-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "cinder-quobyte-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f19253-7b31-4308-99ff-fa2cdad845b4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:45 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a Apr 07 06:10:45 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:45 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 0.667s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 2G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 2G" returned: 0 in 0.126s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.830s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:45 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b66e3963-3253-42d2-9094-35c9c83ade39 tempest-VolumesExtendTest-2080380628 None] Extend volume completed successfully. Apr 07 06:10:45 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" returned: 0 in 0.665s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:45 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a Apr 07 06:10:45 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-5f8c857c-9085-49d7-9f1b-8afef7432e16-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-5f8c857c-9085-49d7-9f1b-8afef7432e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-quobyte-5f8c857c-9085-49d7-9f1b-8afef7432e16" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-5f8c857c-9085-49d7-9f1b-8afef7432e16" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Deleting offline snapshot 5f8c857c-9085-49d7-9f1b-8afef7432e16 of volume 163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] snapshot_file for this snap is: volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ceba3-24e0-4336-a927-32e420fafa01]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:46 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:46 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 Apr 07 06:10:46 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" returned: 0 in 0.702s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "cinder-quobyte-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a" released by "delete_volume" :: held 1.410s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Created reservations ['73136e4b-0136-4ad5-a415-edd0357bfe74', 'b356c40b-2536-4885-a2f7-d65096165b87', '04516bd2-3a6d-4a86-a05c-70baf9299bf7', '00dcc14f-ebbb-4b61-8e3c-ae814328661f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:46 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:46 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.560s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:47 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16" returned: 0 in 0.822s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-163f7957-8e81-4fc4-b962-ce4457c209b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf126918-e534-4164-a155-51a99152d98b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:47 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:47 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:47 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.590s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:47 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Deleted volume successfully. Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1427268c-1f1f-4095-b537-4f4f2346bce8 tempest-VolumesCloneNegativeTest-963700272 None] Lock "cinder-b8e0b3fc-a625-4cb5-8dfb-c5f35ae35b2a-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:47 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 0.848s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:47 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 Apr 07 06:10:47 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:48 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16" returned: 0 in 0.883s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:48 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16 Apr 07 06:10:48 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:49 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0.5f8c857c-9085-49d7-9f1b-8afef7432e16" returned: 0 in 0.680s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-5f8c857c-9085-49d7-9f1b-8afef7432e16" released by "_delete_snapshot" :: held 3.349s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" released by "delete_snapshot" :: held 3.366s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:49 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Created reservations ['12bb432b-3c56-4e2c-90cc-3130dd5943c2', 'b57a62e4-4334-47d4-bcec-d5d9efcc9945', 'd54f5cef-9b22-4a57-8b80-9dd2db3669bc', '457a0ff1-f401-41a3-8291-0ff5d085cbee'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Delete snapshot completed successfully. Apr 07 06:10:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4fe6d4cb-2600-4428-8388-d501e403fd4f tempest-VolumesExtendTest-2080380628 None] Lock "cinder-5f8c857c-9085-49d7-9f1b-8afef7432e16-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (bb0d7eb1-3b50-4f07-ab18-f437f0b23349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f711843-63eb-4b19-a9f3-f02ea8482760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f711843-63eb-4b19-a9f3-f02ea8482760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1265584798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003af497-f2f6-4ef4-a1b8-798a15e27e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:50Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5904b0-e601-4272-adf9-77e520a2d30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5904b0-e601-4272-adf9-77e520a2d30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859c75e0-300c-40f4-9f34-de47775e335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859c75e0-300c-40f4-9f34-de47775e335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003af497-f2f6-4ef4-a1b8-798a15e27e2a', 'volume_name': 'volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4701e1-bea9-498f-9bb6-05c0a47351eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4701e1-bea9-498f-9bb6-05c0a47351eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45e14b0-2da5-4798-8141-66363ea67ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Volume 003af497-f2f6-4ef4-a1b8-798a15e27e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a', 'volume_size': 1} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1265584798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003af497-f2f6-4ef4-a1b8-798a15e27e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:50Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Creating volume 003af497-f2f6-4ef4-a1b8-798a15e27e2a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:50 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:50 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a 1073741824 Apr 07 06:10:50 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-163f7957-8e81-4fc4-b962-ce4457c209b0-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "cinder-163f7957-8e81-4fc4-b962-ce4457c209b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Acquiring lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa881c-0faa-4d06-a9de-3567050446c3]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:50 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:50 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (327b81e3-f189-46c9-ac37-58573b43acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e1620-a423-49e9-bd0b-bd90b1da3ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e1620-a423-49e9-bd0b-bd90b1da3ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120998464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b746cc41-8556-4177-9bf2-e179e5e2c23f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:51Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447c7d45-8dea-4606-88fa-8f04cdb94e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447c7d45-8dea-4606-88fa-8f04cdb94e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeb8f21-63c6-4990-8497-a65be3abc099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeb8f21-63c6-4990-8497-a65be3abc099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b746cc41-8556-4177-9bf2-e179e5e2c23f', 'volume_name': 'volume-b746cc41-8556-4177-9bf2-e179e5e2c23f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83946b4d-9236-4c4e-84ef-5f34d3b08fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83946b4d-9236-4c4e-84ef-5f34d3b08fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1b179d-cd7f-451f-a37f-32f47f58b487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Volume b746cc41-8556-4177-9bf2-e179e5e2c23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b746cc41-8556-4177-9bf2-e179e5e2c23f', 'volume_size': 1} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:50 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a 1073741824" returned: 0 in 0.669s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a Apr 07 06:10:51 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 0.661s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0 Apr 07 06:10:51 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120998464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b746cc41-8556-4177-9bf2-e179e5e2c23f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:51Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Creating volume b746cc41-8556-4177-9bf2-e179e5e2c23f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:51 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45e14b0-2da5-4798-8141-66363ea67ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a28e90-193e-4aca-bcdc-bfbd36ad0307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:51 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f 1073741824 Apr 07 06:10:51 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Volume volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a (003af497-f2f6-4ef4-a1b8-798a15e27e2a): created successfully Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a28e90-193e-4aca-bcdc-bfbd36ad0307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (bb0d7eb1-3b50-4f07-ab18-f437f0b23349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0646e312-321b-4c92-9fe4-d07426f262bb tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:10:51 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-163f7957-8e81-4fc4-b962-ce4457c209b0" returned: 0 in 0.499s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "cinder-quobyte-163f7957-8e81-4fc4-b962-ce4457c209b0" released by "delete_volume" :: held 1.199s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Created reservations ['73bab29b-0912-48e3-8f1c-29b1d12110e0', '507aa733-155a-40d2-b158-8298c305c36d', '9416ff01-7124-4092-9671-d725ef089a47', '846a3bbe-edd7-46ea-b5ac-efee393e6222'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:51 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f 1073741824" returned: 0 in 0.651s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:52 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f Apr 07 06:10:52 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.579s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:52 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Deleted volume successfully. Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a37470b-1b14-4b18-aee9-528049abfeec tempest-VolumesExtendTest-2080380628 None] Lock "cinder-163f7957-8e81-4fc4-b962-ce4457c209b0-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-003af497-f2f6-4ef4-a1b8-798a15e27e2a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "cinder-003af497-f2f6-4ef4-a1b8-798a15e27e2a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-quobyte-003af497-f2f6-4ef4-a1b8-798a15e27e2a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-003af497-f2f6-4ef4-a1b8-798a15e27e2a" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[41293225-cd4b-4d6c-8673-97a85a8d5d3f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:52 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a Apr 07 06:10:52 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f" returned: 0 in 0.566s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1b179d-cd7f-451f-a37f-32f47f58b487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b746cc41-8556-4177-9bf2-e179e5e2c23f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e3e493-2318-45b8-a995-f3660a022e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:52 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Volume volume-b746cc41-8556-4177-9bf2-e179e5e2c23f (b746cc41-8556-4177-9bf2-e179e5e2c23f): created successfully Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e3e493-2318-45b8-a995-f3660a022e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (327b81e3-f189-46c9-ac37-58573b43acb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-19594d86-9c6f-4253-a8f6-6bd5e9ebba23 tempest-VolumesListTestJSON-73690192 None] Created volume successfully. Apr 07 06:10:53 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a" returned: 0 in 0.621s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:53 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a Apr 07 06:10:53 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:53 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-003af497-f2f6-4ef4-a1b8-798a15e27e2a" returned: 0 in 0.656s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-003af497-f2f6-4ef4-a1b8-798a15e27e2a" released by "delete_volume" :: held 1.321s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Created reservations ['873ff270-9f51-4ba1-8e58-6f0a43eba506', '3b3cc000-5c99-4298-b111-b1915befda0a', 'e4b959d3-7625-4397-a98a-513ef54350fc', '1a56cc42-751f-4df0-8b03-44103e76a2b8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:54 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:10:54 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (00e04aa8-f45d-447a-ae4e-94acf4d838fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f494f666-362f-40a6-b42e-d0b935106cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f494f666-362f-40a6-b42e-d0b935106cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-468457021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e65f13b-f0b4-4cde-8751-d9e59d1e9273,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:54Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d150cd94-3efa-4789-9514-0a47120c6d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d150cd94-3efa-4789-9514-0a47120c6d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0c5aa0-4dc7-4447-9abf-7e61907a7cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0c5aa0-4dc7-4447-9abf-7e61907a7cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e65f13b-f0b4-4cde-8751-d9e59d1e9273', 'volume_name': 'volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a0bcb8-470e-4203-b05f-3d4175471f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a0bcb8-470e-4203-b05f-3d4175471f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaed681-fa7a-4b8b-b4ed-3a9368fd331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Volume 0e65f13b-f0b4-4cde-8751-d9e59d1e9273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273', 'volume_size': 1} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-468457021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e65f13b-f0b4-4cde-8751-d9e59d1e9273,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:54Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Creating volume 0e65f13b-f0b4-4cde-8751-d9e59d1e9273 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:54 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:54 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 1073741824 Apr 07 06:10:54 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:54 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.656s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Deleted volume successfully. Apr 07 06:10:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2892044c-1d5c-47f6-b179-c00cbd3c41b6 tempest-VolumesActionsTest-502933474 None] Lock "cinder-003af497-f2f6-4ef4-a1b8-798a15e27e2a-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:55 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 1073741824" returned: 0 in 1.135s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:55 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 Apr 07 06:10:55 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (cfd41392-28bd-4b1a-97d3-c005e84df3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f931f60-5f80-40be-b868-39cd80aa7308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f931f60-5f80-40be-b868-39cd80aa7308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815672948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b80742f-7d95-4353-a420-ac0384765e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:56Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def077ad-e32b-4bab-8151-ac258f71379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def077ad-e32b-4bab-8151-ac258f71379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3143e97b-5736-4471-bc97-475760cf898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3143e97b-5736-4471-bc97-475760cf898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b80742f-7d95-4353-a420-ac0384765e0b', 'volume_name': 'volume-1b80742f-7d95-4353-a420-ac0384765e0b', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5c420b-c394-402f-bad3-67f47d9e7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5c420b-c394-402f-bad3-67f47d9e7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9861e76-7dd6-4187-a1e7-afde94cc2142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Volume 1b80742f-7d95-4353-a420-ac0384765e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b80742f-7d95-4353-a420-ac0384765e0b', 'volume_size': 1} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Flow 'volume_create_manager' (a4bfce0d-893f-45d3-97be-eadffa0fe3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767499ca-f3ef-4bf3-890c-de9f7e9512ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767499ca-f3ef-4bf3-890c-de9f7e9512ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-246051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb8b0b6-2036-41e9-821e-8da9b686a135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c418c4f45f47d39485078db8bde348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:56Z,use_quota=True,user_id='f8544b39ad354034872864993f928f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d59ef5-db27-4e08-9995-cf3852ee348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d59ef5-db27-4e08-9995-cf3852ee348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22acb44f-1024-4bd1-8ece-9bef0facd680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22acb44f-1024-4bd1-8ece-9bef0facd680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb8b0b6-2036-41e9-821e-8da9b686a135', 'volume_name': 'volume-8cb8b0b6-2036-41e9-821e-8da9b686a135', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be8e82a-ed64-4efc-8ba2-e25ae67e3f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be8e82a-ed64-4efc-8ba2-e25ae67e3f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a95df1-2917-46e2-b9b5-55d6a282ff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Volume 8cb8b0b6-2036-41e9-821e-8da9b686a135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb8b0b6-2036-41e9-821e-8da9b686a135', 'volume_size': 1} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:56 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" returned: 0 in 0.709s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815672948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b80742f-7d95-4353-a420-ac0384765e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:56Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Creating volume 1b80742f-7d95-4353-a420-ac0384765e0b {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:56 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaed681-fa7a-4b8b-b4ed-3a9368fd331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee505e40-0eaf-4ec5-84f2-0772f2b30c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b 1073741824 Apr 07 06:10:56 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:56 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Volume volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 (0e65f13b-f0b4-4cde-8751-d9e59d1e9273): created successfully Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee505e40-0eaf-4ec5-84f2-0772f2b30c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (00e04aa8-f45d-447a-ae4e-94acf4d838fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e3fd25ad-01c6-48de-8680-f9592cc226e9 tempest-VolumesListTestJSON-73690192 None] Created volume successfully. Apr 07 06:10:57 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b 1073741824" returned: 0 in 0.801s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:57 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b Apr 07 06:10:57 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (98c94ee2-9ebc-4ece-8b19-014b9ddc82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd6be9-6e38-4d14-8bfc-25567448d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd6be9-6e38-4d14-8bfc-25567448d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572463417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa9ad82-964e-4e85-b5df-401cd71674d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:57Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b092edfa-6c88-459b-9136-d2255df5c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b092edfa-6c88-459b-9136-d2255df5c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c229e6b-b8fa-4461-9481-10ae99954f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c229e6b-b8fa-4461-9481-10ae99954f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa9ad82-964e-4e85-b5df-401cd71674d8', 'volume_name': 'volume-7aa9ad82-964e-4e85-b5df-401cd71674d8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef2fcc-6b8f-499e-b6e5-31637416cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef2fcc-6b8f-499e-b6e5-31637416cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfce0a4-011b-4805-a6de-869cabb72028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Volume 7aa9ad82-964e-4e85-b5df-401cd71674d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa9ad82-964e-4e85-b5df-401cd71674d8', 'volume_size': 1} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:57 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b" returned: 0 in 0.631s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-246051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb8b0b6-2036-41e9-821e-8da9b686a135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c418c4f45f47d39485078db8bde348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:56Z,use_quota=True,user_id='f8544b39ad354034872864993f928f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Creating volume 8cb8b0b6-2036-41e9-821e-8da9b686a135 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:57 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9861e76-7dd6-4187-a1e7-afde94cc2142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b80742f-7d95-4353-a420-ac0384765e0b', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1177143f-9ff9-43c7-b7b8-5b2973630fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:57 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 1073741824 Apr 07 06:10:57 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:57 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Volume volume-1b80742f-7d95-4353-a420-ac0384765e0b (1b80742f-7d95-4353-a420-ac0384765e0b): created successfully Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1177143f-9ff9-43c7-b7b8-5b2973630fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (cfd41392-28bd-4b1a-97d3-c005e84df3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0d2c621a-850b-4b6a-b1dd-e844006104c1 tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:10:58 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 1073741824" returned: 0 in 0.629s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:58 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 Apr 07 06:10:58 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:59 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135" returned: 0 in 0.657s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572463417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa9ad82-964e-4e85-b5df-401cd71674d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='91504ea6b83549cdb2ac94f8a33efdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:57Z,use_quota=True,user_id='dc3fa447395c4ac2a512cb58b285cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Creating volume 7aa9ad82-964e-4e85-b5df-401cd71674d8 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:59 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:59 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 1073741824 Apr 07 06:10:59 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a95df1-2917-46e2-b9b5-55d6a282ff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb8b0b6-2036-41e9-821e-8da9b686a135', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72014c5e-8522-49c8-ba0d-850bdaf12523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-1b80742f-7d95-4353-a420-ac0384765e0b-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Volume volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 (8cb8b0b6-2036-41e9-821e-8da9b686a135): created successfully Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72014c5e-8522-49c8-ba0d-850bdaf12523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Flow 'volume_create_manager' (a4bfce0d-893f-45d3-97be-eadffa0fe3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-571b41e2-85a2-457c-83b6-ba29658dc561 tempest-VolumesNegativeTest-1921321333 None] Created volume successfully. Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "cinder-1b80742f-7d95-4353-a420-ac0384765e0b-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-quobyte-1b80742f-7d95-4353-a420-ac0384765e0b" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-1b80742f-7d95-4353-a420-ac0384765e0b" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[39255a01-319a-410d-8677-200f7d394636]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:59 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b Apr 07 06:10:59 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:00 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 1073741824" returned: 0 in 0.826s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:00 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 Apr 07 06:11:00 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:00 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b" returned: 0 in 0.808s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:00 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b Apr 07 06:11:00 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:00 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8" returned: 0 in 0.620s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfce0a4-011b-4805-a6de-869cabb72028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa9ad82-964e-4e85-b5df-401cd71674d8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69503992-f8f0-4ed9-a8cd-5ebeb9bf7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Volume volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 (7aa9ad82-964e-4e85-b5df-401cd71674d8): created successfully Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69503992-f8f0-4ed9-a8cd-5ebeb9bf7b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Flow 'volume_create_manager' (98c94ee2-9ebc-4ece-8b19-014b9ddc82c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-58d032b2-d74c-4adc-a80c-5d0ab8bc9a3e tempest-VolumesListTestJSON-73690192 None] Created volume successfully. Apr 07 06:11:00 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1b80742f-7d95-4353-a420-ac0384765e0b" returned: 0 in 0.639s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-1b80742f-7d95-4353-a420-ac0384765e0b" released by "delete_volume" :: held 1.507s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Created reservations ['163079a0-efa4-4e07-8d54-8498388d5d87', '6a68b1e4-8ce6-4c0c-90c9-8b7e56755c7e', 'fafed264-c16a-45d7-8381-4643858f3351', '65c66a22-ec16-4d65-a590-6951003b2888'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:01 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:01 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:01 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.664s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Deleted volume successfully. Apr 07 06:11:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-eb8b3c94-c4e9-42e4-acb3-eb7226391c4e tempest-VolumesActionsTest-502933474 None] Lock "cinder-1b80742f-7d95-4353-a420-ac0384765e0b-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (971bff02-8237-4c91-ae06-705cfd3d7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524db0b0-756a-4465-a3df-29d491adb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524db0b0-756a-4465-a3df-29d491adb990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113608764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f52f7cc-2150-40a5-89dd-a870067be61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:02Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f590a-5920-4a17-8fc1-ae9a7f819087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f590a-5920-4a17-8fc1-ae9a7f819087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb86bf0f-cb1b-447d-847d-25aa3435c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb86bf0f-cb1b-447d-847d-25aa3435c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f52f7cc-2150-40a5-89dd-a870067be61a', 'volume_name': 'volume-4f52f7cc-2150-40a5-89dd-a870067be61a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f609b9fb-4a81-4ee0-8569-1f392c6bb0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f609b9fb-4a81-4ee0-8569-1f392c6bb0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ed3ce-3436-48ee-a7c5-5962314fe094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Volume 4f52f7cc-2150-40a5-89dd-a870067be61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f52f7cc-2150-40a5-89dd-a870067be61a', 'volume_size': 1} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113608764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f52f7cc-2150-40a5-89dd-a870067be61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:02Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Creating volume 4f52f7cc-2150-40a5-89dd-a870067be61a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:02 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:02 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a 1073741824 Apr 07 06:11:02 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:02 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a 1073741824" returned: 0 in 0.775s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:02 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a Apr 07 06:11:02 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:03 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a" returned: 0 in 0.641s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ed3ce-3436-48ee-a7c5-5962314fe094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f52f7cc-2150-40a5-89dd-a870067be61a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76f993a-fd5b-4832-9c5e-381bed28bf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:03 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Volume volume-4f52f7cc-2150-40a5-89dd-a870067be61a (4f52f7cc-2150-40a5-89dd-a870067be61a): created successfully Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76f993a-fd5b-4832-9c5e-381bed28bf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (971bff02-8237-4c91-ae06-705cfd3d7666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-98915875-56e5-4ae5-bf1e-1d4405d408dc tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-4f52f7cc-2150-40a5-89dd-a870067be61a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "cinder-4f52f7cc-2150-40a5-89dd-a870067be61a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-quobyte-4f52f7cc-2150-40a5-89dd-a870067be61a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-4f52f7cc-2150-40a5-89dd-a870067be61a" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3562c1-a2a0-4e13-93b1-1ee8cf96fe41]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:04 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a Apr 07 06:11:04 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-7aa9ad82-964e-4e85-b5df-401cd71674d8-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "cinder-7aa9ad82-964e-4e85-b5df-401cd71674d8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:05 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a" returned: 0 in 0.758s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-quobyte-7aa9ad82-964e-4e85-b5df-401cd71674d8" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-7aa9ad82-964e-4e85-b5df-401cd71674d8" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:05 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a Apr 07 06:11:05 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8792d6-2e32-4610-b85a-30eb5b382371]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:05 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 Apr 07 06:11:05 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:05 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4f52f7cc-2150-40a5-89dd-a870067be61a" returned: 0 in 0.616s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-4f52f7cc-2150-40a5-89dd-a870067be61a" released by "delete_volume" :: held 1.435s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Created reservations ['81707472-4de0-4ea9-8675-ff287270a7ae', 'aeb9a812-b698-4e6b-a000-26c510ebd783', 'c14db9bd-97a4-491c-9260-8afc3109c0f3', 'adc14f06-c576-41ea-8db1-3204fab07eb2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:06 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:06 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:06 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8" returned: 0 in 1.028s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:06 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8 Apr 07 06:11:06 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:07 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.086s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:07 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Deleted volume successfully. Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c92a7a7c-84ed-4750-9ccc-52477d407159 tempest-VolumesActionsTest-502933474 None] Lock "cinder-4f52f7cc-2150-40a5-89dd-a870067be61a-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (794aa18d-e982-4a5e-a6e7-91c10ae122a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00aafd1e-ca9f-4298-ac13-d8f6dbec6f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00aafd1e-ca9f-4298-ac13-d8f6dbec6f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1001619777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:07Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c516b59-1dc7-404e-9324-0457d5e7b616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c516b59-1dc7-404e-9324-0457d5e7b616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340788fc-87b0-46dc-b6bd-d2d8fefa4c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340788fc-87b0-46dc-b6bd-d2d8fefa4c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26', 'volume_name': 'volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0535a692-60cb-4acf-8b64-2b165bb7b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0535a692-60cb-4acf-8b64-2b165bb7b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c3221f-1d67-4866-a845-a076ae6ab056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:07 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Volume a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26', 'volume_size': 1} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1001619777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:07Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Creating volume a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:07 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:07 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 1073741824 Apr 07 06:11:07 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:07 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7aa9ad82-964e-4e85-b5df-401cd71674d8" returned: 0 in 1.219s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-7aa9ad82-964e-4e85-b5df-401cd71674d8" released by "delete_volume" :: held 2.306s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Created reservations ['774f52f1-9cf7-48d9-a7fa-e8ad37cbaf62', 'f4835dd9-6f87-4afe-bc16-9e84250d428d', '16243a06-6a21-4b28-927e-715feecf715d', '4c0fede1-bf5a-4cda-a4c6-eb7e6b194abd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:07 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:07 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:08 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-0e65f13b-f0b4-4cde-8751-d9e59d1e9273-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 1073741824" returned: 0 in 1.257s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "cinder-0e65f13b-f0b4-4cde-8751-d9e59d1e9273-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:08 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 Apr 07 06:11:08 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-quobyte-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" acquired by "delete_volume" :: waited 0.028s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:08 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8adb79-cd81-428b-bac1-1981f7c9cb94]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.169s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Deleted volume successfully. Apr 07 06:11:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e8b87f22-1f57-4bae-9d63-7144713ec0fa tempest-VolumesListTestJSON-73690192 None] Lock "cinder-7aa9ad82-964e-4e85-b5df-401cd71674d8-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:09 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 Apr 07 06:11:09 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:09 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" returned: 0 in 0.942s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c3221f-1d67-4866-a845-a076ae6ab056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d16b6b-9944-452d-aed9-d1775927285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Volume volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 (a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26): created successfully Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d16b6b-9944-452d-aed9-d1775927285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (794aa18d-e982-4a5e-a6e7-91c10ae122a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:09 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3937fa3e-ccb5-4332-86cf-4fd723daab5e tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:11:09 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" returned: 0 in 1.024s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:09 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273 Apr 07 06:11:09 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:10 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" returned: 0 in 0.590s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-0e65f13b-f0b4-4cde-8751-d9e59d1e9273" released by "delete_volume" :: held 1.658s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Created reservations ['a1345f8a-1a8a-47ed-bf27-7ba33df019fa', '89ec7477-0992-4ea1-9832-5a9b3203f52b', '0b78f74e-c002-4da0-818b-79b14a2d3d11', '9512b2c0-214d-43e7-86a2-7884c347855a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:10 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:10 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "cinder-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Acquiring lock "cinder-quobyte-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0ced8-ab86-4666-9e9a-21ad44fd61ec]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:10 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 Apr 07 06:11:10 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-b746cc41-8556-4177-9bf2-e179e5e2c23f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "cinder-b746cc41-8556-4177-9bf2-e179e5e2c23f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Acquiring lock "cinder-quobyte-b746cc41-8556-4177-9bf2-e179e5e2c23f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-b746cc41-8556-4177-9bf2-e179e5e2c23f" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[45128990-65d8-4e74-a8a7-3c16c22989ee]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:11 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f Apr 07 06:11:11 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:11 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.754s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:11 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Deleted volume successfully. Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-177ee368-6e65-450a-aff4-2b3e6867769c tempest-VolumesListTestJSON-73690192 None] Lock "cinder-0e65f13b-f0b4-4cde-8751-d9e59d1e9273-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:11 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" returned: 0 in 0.868s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:11 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26 Apr 07 06:11:11 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:11 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f" returned: 0 in 0.691s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:11 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f Apr 07 06:11:11 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:12 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" returned: 0 in 0.720s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "cinder-quobyte-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26" released by "delete_volume" :: held 1.648s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Created reservations ['b05360be-5807-49b5-b510-32f5939cbfd3', 'd882d31a-1ef2-4a93-aee8-b9e791ee65fb', 'c17b211e-c60b-4efa-90cf-21fe3ac5ec2a', 'b9acbdfc-bea8-4d89-8d5b-5962c8feefd5'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:12 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:12 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:12 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b746cc41-8556-4177-9bf2-e179e5e2c23f" returned: 0 in 1.056s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "cinder-quobyte-b746cc41-8556-4177-9bf2-e179e5e2c23f" released by "delete_volume" :: held 1.787s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Created reservations ['9e2e4940-2e17-4d99-83f8-ebe8246d899b', '562ca960-e455-4afb-a2a9-9b7c2ae1f5a0', '4fd492b0-0dae-4e11-8753-7131d0a7acf2', '6fe3030f-28b5-4a14-8339-9d6c85ac78b9'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:13 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:13 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (012b38dd-e9f4-48f3-8099-aa93bc22943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928d6daa-c5ca-41c7-b845-6feb92639416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:14 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928d6daa-c5ca-41c7-b845-6feb92639416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171458044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba7468f-56ff-4593-af5a-7ec85b326e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:14Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2d2fa-299c-4fd3-b6ba-588f929e0a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2d2fa-299c-4fd3-b6ba-588f929e0a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8898b17e-783e-4fb5-ae0c-88ba1008cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8898b17e-783e-4fb5-ae0c-88ba1008cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba7468f-56ff-4593-af5a-7ec85b326e66', 'volume_name': 'volume-6ba7468f-56ff-4593-af5a-7ec85b326e66', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2819aa7c-d462-405d-8183-187b6eee9c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2819aa7c-d462-405d-8183-187b6eee9c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfd5cf9-89ec-4f63-b41d-f3098a6bd7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:14 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Volume 6ba7468f-56ff-4593-af5a-7ec85b326e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba7468f-56ff-4593-af5a-7ec85b326e66', 'volume_size': 1} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171458044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba7468f-56ff-4593-af5a-7ec85b326e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd25e4aa64bf47ffbeafaa60a921ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:14Z,use_quota=True,user_id='11974423210c494c98e69fe0cd694d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Creating volume 6ba7468f-56ff-4593-af5a-7ec85b326e66 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.443s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Deleted volume successfully. Apr 07 06:11:14 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 1073741824 Apr 07 06:11:14 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79d8f091-3ed1-4fd1-97ec-2d13710111b1 tempest-VolumesActionsTest-502933474 None] Lock "cinder-a93bbcc8-ed20-4cd7-b2e9-e6cbc4936d26-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:14 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.272s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Deleted volume successfully. Apr 07 06:11:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f9db1314-2479-4dc5-ace5-6b6bf8ff07de tempest-VolumesListTestJSON-73690192 None] Lock "cinder-b746cc41-8556-4177-9bf2-e179e5e2c23f-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:15 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 1073741824" returned: 0 in 1.300s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:15 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 Apr 07 06:11:15 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:17 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66" returned: 0 in 1.580s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.986s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfd5cf9-89ec-4f63-b41d-f3098a6bd7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba7468f-56ff-4593-af5a-7ec85b326e66', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f22515-e779-47b0-90b6-483ee076c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Volume volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 (6ba7468f-56ff-4593-af5a-7ec85b326e66): created successfully Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f22515-e779-47b0-90b6-483ee076c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Flow 'volume_create_manager' (012b38dd-e9f4-48f3-8099-aa93bc22943b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b31c8508-a968-4da5-ace6-c4d200cd99f2 tempest-VolumesActionsTest-728014197 None] Created volume successfully. Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (f72d0119-ae9a-4abb-8a99-cd949fe14c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f4be4-7a75-465c-86e8-e464eb2d3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f4be4-7a75-465c-86e8-e464eb2d3d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080045702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc9197e-60b2-4884-97dc-7e0d0810ca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:19Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2943014f-e272-41eb-a081-dceff1c60787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2943014f-e272-41eb-a081-dceff1c60787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67213822-b8da-4c78-9400-501008874a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67213822-b8da-4c78-9400-501008874a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc9197e-60b2-4884-97dc-7e0d0810ca4e', 'volume_name': 'volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b086502-bd8d-460c-a576-1ec86f1abcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b086502-bd8d-460c-a576-1ec86f1abcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f56df-e6ff-4942-bd5a-6b7d9038e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:18 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Volume 7bc9197e-60b2-4884-97dc-7e0d0810ca4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e', 'volume_size': 1} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080045702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc9197e-60b2-4884-97dc-7e0d0810ca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:19Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Creating volume 7bc9197e-60b2-4884-97dc-7e0d0810ca4e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:18 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:19 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e 1073741824 Apr 07 06:11:19 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (e6718893-5378-43b9-94e2-b9d819df43d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c715e89d-a741-41d0-8d33-0d2370e2af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-6ba7468f-56ff-4593-af5a-7ec85b326e66-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c715e89d-a741-41d0-8d33-0d2370e2af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386200235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b5001-551f-4ce9-adab-c5011cd33b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:20Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78bdcb5-07c7-429b-9a25-01371b5a3aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78bdcb5-07c7-429b-9a25-01371b5a3aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97107d50-dd1c-4e95-a007-b461c1e81803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97107d50-dd1c-4e95-a007-b461c1e81803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045b5001-551f-4ce9-adab-c5011cd33b68', 'volume_name': 'volume-045b5001-551f-4ce9-adab-c5011cd33b68', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bd91e9-0273-4da8-8976-54310ab46ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bd91e9-0273-4da8-8976-54310ab46ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0d209-0d7d-491a-9153-2b4f04d301b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Volume 045b5001-551f-4ce9-adab-c5011cd33b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045b5001-551f-4ce9-adab-c5011cd33b68', 'volume_size': 1} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "cinder-6ba7468f-56ff-4593-af5a-7ec85b326e66-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Acquiring lock "cinder-quobyte-6ba7468f-56ff-4593-af5a-7ec85b326e66" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "cinder-quobyte-6ba7468f-56ff-4593-af5a-7ec85b326e66" acquired by "delete_volume" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d846a27-73d1-460b-bace-c88c5e15df60]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:20 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 Apr 07 06:11:20 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (ed2e5b3b-5ff8-4031-9c5a-0c7dcba8e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955df88a-bf5c-4d81-9c21-10d70bffdc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955df88a-bf5c-4d81-9c21-10d70bffdc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923859736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fffe32-d73a-4ce4-9e62-2273bde61533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:20Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4515830-80cb-41f7-be41-2dda912a5ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4515830-80cb-41f7-be41-2dda912a5ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf349e7-99e7-492a-82a9-7e91f42826f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf349e7-99e7-492a-82a9-7e91f42826f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97fffe32-d73a-4ce4-9e62-2273bde61533', 'volume_name': 'volume-97fffe32-d73a-4ce4-9e62-2273bde61533', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb44c08-8c34-4d5f-a5e0-dc25e72f4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb44c08-8c34-4d5f-a5e0-dc25e72f4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808acf48-212b-4eeb-a122-9b833e517e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Volume 97fffe32-d73a-4ce4-9e62-2273bde61533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97fffe32-d73a-4ce4-9e62-2273bde61533', 'volume_size': 1} Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:20 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e 1073741824" returned: 0 in 1.969s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (f122c66c-41b5-490f-ad85-263c33bf421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2850ad11-9950-47e6-8b8f-55abc6ef79d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2850ad11-9950-47e6-8b8f-55abc6ef79d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205424580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a37bbe-a6fc-40c3-9b28-b55762b872ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:21Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c3aa3e-2afb-4587-8468-d8879a471414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c3aa3e-2afb-4587-8468-d8879a471414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e599f98-046a-4bdf-9293-9cf760ed7788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e599f98-046a-4bdf-9293-9cf760ed7788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a37bbe-a6fc-40c3-9b28-b55762b872ac', 'volume_name': 'volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032bf1a-2eea-4949-80c9-732786e73438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032bf1a-2eea-4949-80c9-732786e73438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ed2278-b843-4da4-aedb-3528eb0033a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Volume 81a37bbe-a6fc-40c3-9b28-b55762b872ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac', 'volume_size': 1} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (19da4d9e-6fc5-43f9-a6f4-e315aee76de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215aab9c-60e0-4a1c-afc6-3c7befd3950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215aab9c-60e0-4a1c-afc6-3c7befd3950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982139681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf471a-4752-45ca-9245-1aa843ca6061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:22Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af0ef54-60c1-4d65-8782-3d36835d06ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af0ef54-60c1-4d65-8782-3d36835d06ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679aef54-39d9-4a64-bf1e-359ea5609c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679aef54-39d9-4a64-bf1e-359ea5609c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdf471a-4752-45ca-9245-1aa843ca6061', 'volume_name': 'volume-7fdf471a-4752-45ca-9245-1aa843ca6061', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa69f01d-879d-4316-94f5-54e36b07b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa69f01d-879d-4316-94f5-54e36b07b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f137c6ac-a22f-4ed9-bfcb-d940c1f8167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Volume 7fdf471a-4752-45ca-9245-1aa843ca6061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdf471a-4752-45ca-9245-1aa843ca6061', 'volume_size': 1} Apr 07 06:11:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:22 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66" returned: 0 in 2.141s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:22 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66 Apr 07 06:11:22 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:22 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" returned: 0 in 1.271s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] <== create_volume: return (3558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.560s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.569s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386200235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b5001-551f-4ce9-adab-c5011cd33b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:20Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Creating volume 045b5001-551f-4ce9-adab-c5011cd33b68 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:22 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f56df-e6ff-4942-bd5a-6b7d9038e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:22 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 1073741824 Apr 07 06:11:22 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c5565b-37a4-493e-9501-10bf23fb4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:22 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Volume volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e (7bc9197e-60b2-4884-97dc-7e0d0810ca4e): created successfully Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c5565b-37a4-493e-9501-10bf23fb4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:22 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (f72d0119-ae9a-4abb-8a99-cd949fe14c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ef6b10f9-1ae0-47e7-8040-35e99778d837 tempest-CreateVolumesFromImageTest-2064623249 None] Created volume successfully. Apr 07 06:11:23 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6ba7468f-56ff-4593-af5a-7ec85b326e66" returned: 0 in 0.953s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "cinder-quobyte-6ba7468f-56ff-4593-af5a-7ec85b326e66" released by "delete_volume" :: held 3.144s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Created reservations ['c5734944-85ce-4be4-9c74-cc1b2ecad0ce', 'df8b03f3-191c-43a0-b6f2-0cf7bcc87a2b', '04e00c81-2425-44f3-8c85-69d3ffb97c4c', '47f0797d-c5a2-4f8f-bd80-3a00e069e060'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:23 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:23 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:23 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 1073741824" returned: 0 in 0.813s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:23 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 Apr 07 06:11:23 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:23 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68" returned: 0 in 0.690s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.514s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923859736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fffe32-d73a-4ce4-9e62-2273bde61533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:20Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Creating volume 97fffe32-d73a-4ce4-9e62-2273bde61533 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:23 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 1073741824 Apr 07 06:11:24 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0d209-0d7d-491a-9153-2b4f04d301b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045b5001-551f-4ce9-adab-c5011cd33b68', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f069a405-6e1a-4327-a618-daeae9aa2de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Volume volume-045b5001-551f-4ce9-adab-c5011cd33b68 (045b5001-551f-4ce9-adab-c5011cd33b68): created successfully Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f069a405-6e1a-4327-a618-daeae9aa2de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (e6718893-5378-43b9-94e2-b9d819df43d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8c92829f-6470-4a35-adfe-1f9d5f586c1d tempest-CreateVolumesFromImageTest-2064623249 None] Created volume successfully. Apr 07 06:11:24 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.942s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Deleted volume successfully. Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6bb35819-96df-48e0-b1dc-d59d4120579c tempest-VolumesActionsTest-728014197 None] Lock "cinder-6ba7468f-56ff-4593-af5a-7ec85b326e66-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:24 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 1073741824" returned: 0 in 0.836s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 Apr 07 06:11:24 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Flow 'volume_create_manager' (187d975b-74db-42e7-a791-cfbe6de5c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81f5d77-49f5-418d-b23d-804980c611c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81f5d77-49f5-418d-b23d-804980c611c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1441646540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b7f4fb-eaa5-435d-97d5-2aeaedad3652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e953fc8c94c5fa210543f616cbbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:26Z,use_quota=True,user_id='12633c45b8d141dfade3551c3878f715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2cb260-bc55-48f6-a66e-a500441fc929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2cb260-bc55-48f6-a66e-a500441fc929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05763740-f3a2-44ba-9a4f-bab7c52c4b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05763740-f3a2-44ba-9a4f-bab7c52c4b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b7f4fb-eaa5-435d-97d5-2aeaedad3652', 'volume_name': 'volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377b057e-ce68-4883-b796-482424d4502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377b057e-ce68-4883-b796-482424d4502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72389a8c-706f-4d92-a443-713abd2270c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Volume 51b7f4fb-eaa5-435d-97d5-2aeaedad3652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652', 'volume_size': 1} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533" returned: 0 in 0.851s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.402s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205424580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a37bbe-a6fc-40c3-9b28-b55762b872ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:21Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Creating volume 81a37bbe-a6fc-40c3-9b28-b55762b872ac {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:25 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808acf48-212b-4eeb-a122-9b833e517e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fffe32-d73a-4ce4-9e62-2273bde61533', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac 1073741824 Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5afb8a-0cfc-4d90-8817-6108d3a8baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:25 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:25 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Volume volume-97fffe32-d73a-4ce4-9e62-2273bde61533 (97fffe32-d73a-4ce4-9e62-2273bde61533): created successfully Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5afb8a-0cfc-4d90-8817-6108d3a8baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (ed2e5b3b-5ff8-4031-9c5a-0c7dcba8e96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b2048a84-c048-4f61-b034-8d1313e687f2 tempest-CreateVolumesFromImageTest-2064623249 None] Created volume successfully. Apr 07 06:11:26 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac 1073741824" returned: 0 in 0.798s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:26 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac Apr 07 06:11:26 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:27 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac" returned: 0 in 0.726s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.315s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982139681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf471a-4752-45ca-9245-1aa843ca6061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a533b382142a39ba2ae3f07caabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:22Z,use_quota=True,user_id='e8d754e9003b4b76b784c4fa3732299b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Creating volume 7fdf471a-4752-45ca-9245-1aa843ca6061 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:27 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ed2278-b843-4da4-aedb-3528eb0033a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d927b78b-9547-444e-9a08-02348bf0b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:27 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 1073741824 Apr 07 06:11:27 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:27 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Volume volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac (81a37bbe-a6fc-40c3-9b28-b55762b872ac): created successfully Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d927b78b-9547-444e-9a08-02348bf0b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (f122c66c-41b5-490f-ad85-263c33bf421b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:27 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1708d2e0-e6c5-4680-b380-ecce9e512699 tempest-CreateVolumesFromImageTest-2064623249 None] Created volume successfully. Apr 07 06:11:28 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 1073741824" returned: 0 in 1.039s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:28 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 Apr 07 06:11:28 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:29 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061" returned: 0 in 0.685s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.376s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1441646540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b7f4fb-eaa5-435d-97d5-2aeaedad3652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e953fc8c94c5fa210543f616cbbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:26Z,use_quota=True,user_id='12633c45b8d141dfade3551c3878f715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Creating volume 51b7f4fb-eaa5-435d-97d5-2aeaedad3652 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:29 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f137c6ac-a22f-4ed9-bfcb-d940c1f8167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdf471a-4752-45ca-9245-1aa843ca6061', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:29 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 1073741824 Apr 07 06:11:29 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc94f8-1650-4a18-a8eb-81536e097d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:29 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Volume volume-7fdf471a-4752-45ca-9245-1aa843ca6061 (7fdf471a-4752-45ca-9245-1aa843ca6061): created successfully Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc94f8-1650-4a18-a8eb-81536e097d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Flow 'volume_create_manager' (19da4d9e-6fc5-43f9-a6f4-e315aee76de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-57c6e429-1207-4a13-aaa5-b2b16c15585f tempest-CreateVolumesFromImageTest-2064623249 None] Created volume successfully. Apr 07 06:11:29 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 1073741824" returned: 0 in 0.713s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-7fdf471a-4752-45ca-9245-1aa843ca6061-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-7fdf471a-4752-45ca-9245-1aa843ca6061-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:29 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 Apr 07 06:11:29 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-quobyte-7fdf471a-4752-45ca-9245-1aa843ca6061" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-7fdf471a-4752-45ca-9245-1aa843ca6061" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1839077-bbe5-4fce-b7ba-dea991186013]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:30 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 Apr 07 06:11:30 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:30 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" returned: 0 in 0.819s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72389a8c-706f-4d92-a443-713abd2270c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d4935-08dc-45a5-aede-5cdae8da17dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Volume volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 (51b7f4fb-eaa5-435d-97d5-2aeaedad3652): created successfully Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d4935-08dc-45a5-aede-5cdae8da17dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Flow 'volume_create_manager' (187d975b-74db-42e7-a791-cfbe6de5c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:30 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-09f022ae-2ba4-4ad2-8f72-e601a9c6bf3d tempest-ServersNegativeTestJSON-826903037 None] Created volume successfully. Apr 07 06:11:31 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061" returned: 0 in 1.283s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:31 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061 Apr 07 06:11:31 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:32 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7fdf471a-4752-45ca-9245-1aa843ca6061" returned: 0 in 0.949s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-7fdf471a-4752-45ca-9245-1aa843ca6061" released by "delete_volume" :: held 2.273s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Created reservations ['b628c186-59b9-4ff4-b113-12635e0ce272', '734ae792-46f9-4b69-97bb-430cbc3232aa', '1969f331-eb4e-4153-9d57-0b105aef2220', '55bbbc9c-2512-4344-9dcc-3b094f5edc38'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:32 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:32 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:32 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Flow 'volume_create_manager' (b27f59be-3794-4add-a379-58a8692db247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c6665-08c6-4ba5-be7f-1d66d5a620ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c6665-08c6-4ba5-be7f-1d66d5a620ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-502096599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4e3b65-6314-4af6-92d3-dfa96cb761ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e953fc8c94c5fa210543f616cbbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:33Z,use_quota=True,user_id='12633c45b8d141dfade3551c3878f715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495931ca-6d16-4934-b21c-2a115993a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495931ca-6d16-4934-b21c-2a115993a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e25be5-6333-4cbd-ba0a-11022b9be0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e25be5-6333-4cbd-ba0a-11022b9be0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4e3b65-6314-4af6-92d3-dfa96cb761ae', 'volume_name': 'volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64fa31c-2bfe-41b0-bb65-d7803cad3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64fa31c-2bfe-41b0-bb65-d7803cad3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7696e9d-4bc5-41b4-be54-1b900c1d1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:33 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Volume 5b4e3b65-6314-4af6-92d3-dfa96cb761ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae', 'volume_size': 1} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-502096599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4e3b65-6314-4af6-92d3-dfa96cb761ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e953fc8c94c5fa210543f616cbbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:33Z,use_quota=True,user_id='12633c45b8d141dfade3551c3878f715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Creating volume 5b4e3b65-6314-4af6-92d3-dfa96cb761ae {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:33 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:33 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae 1073741824 Apr 07 06:11:33 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:33 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.877s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Deleted volume successfully. Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4f97c352-815c-450a-9f80-f6ab3d586fc9 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-7fdf471a-4752-45ca-9245-1aa843ca6061-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-81a37bbe-a6fc-40c3-9b28-b55762b872ac-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-81a37bbe-a6fc-40c3-9b28-b55762b872ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-quobyte-81a37bbe-a6fc-40c3-9b28-b55762b872ac" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-81a37bbe-a6fc-40c3-9b28-b55762b872ac" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3a0c4-3a66-42f9-9486-efade6412e73]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:33 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac Apr 07 06:11:33 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:34 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae 1073741824" returned: 0 in 1.319s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:34 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae Apr 07 06:11:34 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:34 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac" returned: 0 in 1.084s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:34 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac Apr 07 06:11:34 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:35 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-81a37bbe-a6fc-40c3-9b28-b55762b872ac" returned: 0 in 0.826s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-81a37bbe-a6fc-40c3-9b28-b55762b872ac" released by "delete_volume" :: held 1.951s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Created reservations ['f4d8d370-6c41-4632-95aa-474726c449b3', 'a3bfe1dd-244c-4c8d-a5aa-a18716e74b72', '4607db91-0b1c-4bbc-a6e7-b7f78f091fab', 'f89ff646-bf2e-4c8e-a40a-ee7296eeeed7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:35 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:35 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:35 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" returned: 0 in 1.226s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] <== create_volume: return (2590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7696e9d-4bc5-41b4-be54-1b900c1d1d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44064ffe-729c-4a49-a766-94003d0d71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-97fffe32-d73a-4ce4-9e62-2273bde61533-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:35 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Volume volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae (5b4e3b65-6314-4af6-92d3-dfa96cb761ae): created successfully Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44064ffe-729c-4a49-a766-94003d0d71e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Flow 'volume_create_manager' (b27f59be-3794-4add-a379-58a8692db247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-98069e0a-619c-45f5-9fc2-9b709cc78b6d tempest-ServersNegativeTestJSON-826903037 None] Created volume successfully. Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-97fffe32-d73a-4ce4-9e62-2273bde61533-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-quobyte-97fffe32-d73a-4ce4-9e62-2273bde61533" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-97fffe32-d73a-4ce4-9e62-2273bde61533" acquired by "delete_volume" :: waited 0.022s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8196832-e79e-4232-ac6b-703159acc309]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 Apr 07 06:11:36 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Acquiring lock "cinder-8cb8b0b6-2036-41e9-821e-8da9b686a135-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "cinder-8cb8b0b6-2036-41e9-821e-8da9b686a135-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Acquiring lock "cinder-quobyte-8cb8b0b6-2036-41e9-821e-8da9b686a135" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "cinder-quobyte-8cb8b0b6-2036-41e9-821e-8da9b686a135" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ce21e-ddbb-4533-9bff-941ac284458c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.847s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Deleted volume successfully. Apr 07 06:11:36 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 Apr 07 06:11:36 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6902ce2a-a59e-4e8e-a580-8302ff465ca3 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-81a37bbe-a6fc-40c3-9b28-b55762b872ac-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "cinder-5b4e3b65-6314-4af6-92d3-dfa96cb761ae-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-5b4e3b65-6314-4af6-92d3-dfa96cb761ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "cinder-quobyte-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-quobyte-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf547f-ee17-4a07-a69c-a317bdda3abf]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae Apr 07 06:11:36 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533" returned: 0 in 0.929s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533 Apr 07 06:11:36 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:37 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135" returned: 0 in 0.717s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:37 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135 Apr 07 06:11:37 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:37 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" returned: 0 in 0.663s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:37 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae Apr 07 06:11:37 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:37 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97fffe32-d73a-4ce4-9e62-2273bde61533" returned: 0 in 0.561s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-97fffe32-d73a-4ce4-9e62-2273bde61533" released by "delete_volume" :: held 1.535s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Created reservations ['d998c04b-5929-4184-bdb9-1c7fd3eb96b7', '5fabf2ea-6b7e-4ca6-9b48-c82c33aa736b', '7932eb8b-2791-44dd-8d61-8d88171ee927', '49819c7e-3b0b-413d-92d4-d071ef1f1fc5'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:37 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:37 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:37 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8cb8b0b6-2036-41e9-821e-8da9b686a135" returned: 0 in 0.681s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "cinder-quobyte-8cb8b0b6-2036-41e9-821e-8da9b686a135" released by "delete_volume" :: held 1.440s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Created reservations ['95650489-c3c9-40da-943b-0159f061a4ce', 'e1006244-857f-4344-92f5-77783c0883a8', 'ba6265ea-edff-463e-ad02-13fe88055ea9', '362de544-cafc-4a8b-9390-eb67dac3e9d0'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:37 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:37 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-045b5001-551f-4ce9-adab-c5011cd33b68-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-045b5001-551f-4ce9-adab-c5011cd33b68-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-quobyte-045b5001-551f-4ce9-adab-c5011cd33b68" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-045b5001-551f-4ce9-adab-c5011cd33b68" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08fa309-778a-40c1-80e1-63960e9adb86]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" returned: 0 in 0.675s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-quobyte-5b4e3b65-6314-4af6-92d3-dfa96cb761ae" released by "delete_volume" :: held 1.379s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Created reservations ['91773da5-3f9b-4939-a0c2-76e1a59c6d1b', 'cc15cffb-5a40-46ea-b3fb-08ac70b1044f', 'bef24e4a-5c54-4c44-8844-f5595607ec23', '6ad948af-e3f7-4c77-b8c8-24b93a3b344d'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:38 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 Apr 07 06:11:38 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.731s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Deleted volume successfully. Apr 07 06:11:38 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:38 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1a5f4733-f028-4ced-83d6-bc6edf551b57 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-97fffe32-d73a-4ce4-9e62-2273bde61533-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:38 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.719s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Deleted volume successfully. Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2dc9aaec-4c56-40e2-a5b8-589419608c8b tempest-VolumesNegativeTest-1921321333 None] Lock "cinder-8cb8b0b6-2036-41e9-821e-8da9b686a135-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (b3194a4f-2ddb-47a4-b6be-eb586787738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f664d1f-9e52-4384-adfc-a50307ee5432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f664d1f-9e52-4384-adfc-a50307ee5432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373924013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8e4bf-97a1-42a1-b682-c3728e63fa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:39Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc096ea6-1dea-4d78-9fde-44daffd29437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc096ea6-1dea-4d78-9fde-44daffd29437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e48255-3890-4d50-8140-7aeb0e7dbab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e48255-3890-4d50-8140-7aeb0e7dbab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee8e4bf-97a1-42a1-b682-c3728e63fa9a', 'volume_name': 'volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db4b64e-dcf0-49e4-a3c1-368c86a7b41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db4b64e-dcf0-49e4-a3c1-368c86a7b41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a3be03-dfd1-41e8-ac12-ee6d160d423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Volume aee8e4bf-97a1-42a1-b682-c3728e63fa9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a', 'volume_size': 1} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373924013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8e4bf-97a1-42a1-b682-c3728e63fa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:39Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Creating volume aee8e4bf-97a1-42a1-b682-c3728e63fa9a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:39 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:39 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "cinder-51b7f4fb-eaa5-435d-97d5-2aeaedad3652-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.735s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:39 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a 1073741824 Apr 07 06:11:39 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Deleted volume successfully. Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-51b7f4fb-eaa5-435d-97d5-2aeaedad3652-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62804e3c-034f-4612-b3da-347027a25021 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-5b4e3b65-6314-4af6-92d3-dfa96cb761ae-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:39 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68" returned: 0 in 1.014s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "cinder-quobyte-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:39 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68 Apr 07 06:11:39 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-quobyte-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35ed455-c563-4004-bf87-394e1902e662]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 Apr 07 06:11:39 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-045b5001-551f-4ce9-adab-c5011cd33b68" returned: 0 in 0.525s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-045b5001-551f-4ce9-adab-c5011cd33b68" released by "delete_volume" :: held 1.575s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Created reservations ['c61ef465-c090-41d5-b090-84e72009c8ba', '4938b0e2-e0e7-4a6e-93ff-95a1238c82c8', 'b3555449-4bcd-4e8f-b6ef-eeb11690798f', '81226a44-8c51-4e92-bdd3-15d8629ba223'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:39 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a 1073741824" returned: 0 in 0.696s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:39 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a Apr 07 06:11:39 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" returned: 0 in 0.772s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652 Apr 07 06:11:39 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:40 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.536s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Deleted volume successfully. Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ae5f23d-743f-46bb-9b53-be506f5e09e0 tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-045b5001-551f-4ce9-adab-c5011cd33b68-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-7bc9197e-60b2-4884-97dc-7e0d0810ca4e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-7bc9197e-60b2-4884-97dc-7e0d0810ca4e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "cinder-quobyte-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:40 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" returned: 0 in 0.662s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f774997-1375-41d6-a7f2-82d2d01e19d4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a3be03-dfd1-41e8-ac12-ee6d160d423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feeadf5-eb82-42ba-a487-92235e976205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:40 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Volume volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a (aee8e4bf-97a1-42a1-b682-c3728e63fa9a): created successfully Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feeadf5-eb82-42ba-a487-92235e976205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (b3194a4f-2ddb-47a4-b6be-eb586787738b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0d203c4b-923c-43d1-9368-cfcd7b95fb8d tempest-VolumesListAdminTestJSON-1192303666 None] Created volume successfully. Apr 07 06:11:40 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e Apr 07 06:11:40 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:40 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" returned: 0 in 0.669s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-quobyte-51b7f4fb-eaa5-435d-97d5-2aeaedad3652" released by "delete_volume" :: held 1.483s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Created reservations ['e6eaac56-3663-4891-88e4-575a39b59f13', '99883016-9514-4687-8129-dc92aeef86ff', '2f739ace-b657-48f5-882f-ad47f70342de', '7bc504f7-4fa4-4e12-b15c-6ebf23fe6959'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:40 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:40 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:41 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Flow 'volume_create_manager' (c130287a-247e-42f9-8442-ee24e38ab912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35891c89-6cf3-40d6-8b5e-ca46837f853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35891c89-6cf3-40d6-8b5e-ca46837f853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-493095047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67faf62b-a6b6-4325-b1a9-81636e12dd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7c4b135ac9402b98805142804917cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:41Z,use_quota=True,user_id='3f0c96bbfdde4f96abf48495a028fdd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1948e21-af53-480f-841b-812c72aa787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1948e21-af53-480f-841b-812c72aa787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408220b-d300-4eea-992f-1daac40541c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408220b-d300-4eea-992f-1daac40541c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67faf62b-a6b6-4325-b1a9-81636e12dd3b', 'volume_name': 'volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b', 'volume_size': 2}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ae9e79-7272-4f70-9c08-ee4548d0f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ae9e79-7272-4f70-9c08-ee4548d0f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af1d7-8532-4eb6-a8fa-49b5a6b5fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Volume 67faf62b-a6b6-4325-b1a9-81636e12dd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b', 'volume_size': 2} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-493095047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67faf62b-a6b6-4325-b1a9-81636e12dd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7c4b135ac9402b98805142804917cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:41Z,use_quota=True,user_id='3f0c96bbfdde4f96abf48495a028fdd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Creating volume 67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:41 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b 2147483648 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" returned: 0 in 0.818s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:41 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b 2147483648 Apr 07 06:11:41 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:41 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e Apr 07 06:11:41 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:41 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.654s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:41 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Deleted volume successfully. Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2fd89332-dcb4-47b6-bb18-23f67d88eae9 tempest-ServersNegativeTestJSON-826903037 None] Lock "cinder-51b7f4fb-eaa5-435d-97d5-2aeaedad3652-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (590783fb-f130-4d03-b15b-1d94c1dccaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c389e45-4b5b-46f1-a3d1-cbdd8093cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c389e45-4b5b-46f1-a3d1-cbdd8093cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-598420072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737a262a-edcd-4c0d-8066-d0176c530a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:41Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c133753b-f52b-4d8c-8b15-d46436d400fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c133753b-f52b-4d8c-8b15-d46436d400fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccf50d1-aeb4-4768-ab20-e2f8bcf50b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccf50d1-aeb4-4768-ab20-e2f8bcf50b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737a262a-edcd-4c0d-8066-d0176c530a13', 'volume_name': 'volume-737a262a-edcd-4c0d-8066-d0176c530a13', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0fb4c-f787-49f1-b8b6-0b1d730b2b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0fb4c-f787-49f1-b8b6-0b1d730b2b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858d02dc-85a1-42fc-88e4-f3e2efa46285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Volume 737a262a-edcd-4c0d-8066-d0176c530a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737a262a-edcd-4c0d-8066-d0176c530a13', 'volume_size': 1} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:41 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" returned: 0 in 0.648s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-quobyte-7bc9197e-60b2-4884-97dc-7e0d0810ca4e" released by "delete_volume" :: held 1.494s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:41 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Created reservations ['0a9abd7f-dae0-4ff9-9045-dff92f49bea3', '899a2fc3-55c8-431c-9bd0-cefcedc182b5', '7d6964e3-3501-458a-9b4a-4d813ce81708', '9f3b06b3-eca8-4df1-aa10-ebd031201d90'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:41 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b 2147483648" returned: 0 in 0.748s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:42 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b Apr 07 06:11:42 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:42 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:42 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:42 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.575s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Deleted volume successfully. Apr 07 06:11:42 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b" returned: 0 in 0.667s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.118s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-598420072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737a262a-edcd-4c0d-8066-d0176c530a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:41Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Creating volume 737a262a-edcd-4c0d-8066-d0176c530a13 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:42 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af1d7-8532-4eb6-a8fa-49b5a6b5fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b', 'volume_size': 2}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82377db7-3d4a-48ac-b066-edad83d54d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 1073741824 Apr 07 06:11:42 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-6da7d3fb-3831-4a0e-8fc4-973d09a0bcfa tempest-CreateVolumesFromImageTest-2064623249 None] Lock "cinder-7bc9197e-60b2-4884-97dc-7e0d0810ca4e-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Volume volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b (67faf62b-a6b6-4325-b1a9-81636e12dd3b): created successfully Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82377db7-3d4a-48ac-b066-edad83d54d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Flow 'volume_create_manager' (c130287a-247e-42f9-8442-ee24e38ab912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-67dee642-028e-40cc-9bcf-bd038647cdb2 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Created volume successfully. Apr 07 06:11:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:43 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 1073741824" returned: 0 in 1.021s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:43 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 Apr 07 06:11:43 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:44 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13" returned: 0 in 0.647s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.895s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=202,cinder:DELETE=25,cinder:SELECT=140,cinder:INSERT=59 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858d02dc-85a1-42fc-88e4-f3e2efa46285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737a262a-edcd-4c0d-8066-d0176c530a13', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074bef1-471e-4003-8489-e927dd32f631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=133,cinder:INSERT=37,cinder:UPDATE=221,cinder:DELETE=12 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Creating offline snapshot f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 of volume 67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:44 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Volume volume-737a262a-edcd-4c0d-8066-d0176c530a13 (737a262a-edcd-4c0d-8066-d0176c530a13): created successfully Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074bef1-471e-4003-8489-e927dd32f631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (590783fb-f130-4d03-b15b-1d94c1dccaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11a45c5-0fdf-4086-8da8-0a01968de1aa]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c216fc56-5e02-461d-856a-9df8fff1b058 tempest-VolumesListAdminTestJSON-1192303666 None] Created volume successfully. Apr 07 06:11:44 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b Apr 07 06:11:44 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:45 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b" returned: 0 in 0.787s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 2G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:45 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 2G Apr 07 06:11:45 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (ced5ee6b-4a7b-4bda-8a45-95d5df817932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2452c8-6f3b-4fd8-b976-1be1b3396cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2452c8-6f3b-4fd8-b976-1be1b3396cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2085346292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a8c780-c0b8-49ff-9187-8f3d4af93cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:45Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02175f95-ffc0-4602-8ee4-910be515bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02175f95-ffc0-4602-8ee4-910be515bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2464e0-1007-4a35-b6d7-52d06c1aec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2464e0-1007-4a35-b6d7-52d06c1aec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a8c780-c0b8-49ff-9187-8f3d4af93cf4', 'volume_name': 'volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8a5980-e02c-42f6-9666-6c564f40ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8a5980-e02c-42f6-9666-6c564f40ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e06ab1-8cac-41d3-ae58-547f6eb266f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Volume 04a8c780-c0b8-49ff-9187-8f3d4af93cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4', 'volume_size': 1} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (930dfa31-6049-44f9-b9b4-015bd8da75d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8338fba2-5123-4f54-81a8-a8131e50ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8338fba2-5123-4f54-81a8-a8131e50ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35436562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e243a1-d87b-4a1c-b9cf-46d4b39d9745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:46Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4482a506-6432-4f72-ac9a-7b878d169b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4482a506-6432-4f72-ac9a-7b878d169b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90146a35-3a12-4e1a-97ec-0f42845ee313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90146a35-3a12-4e1a-97ec-0f42845ee313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e243a1-d87b-4a1c-b9cf-46d4b39d9745', 'volume_name': 'volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3f9801-9542-436f-8c8a-450708cc8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3f9801-9542-436f-8c8a-450708cc8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249d2e6a-b0b8-491c-979f-14451663c868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:45 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume 10e243a1-d87b-4a1c-b9cf-46d4b39d9745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745', 'volume_size': 1} Apr 07 06:11:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 2G" returned: 0 in 0.864s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:46 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 Apr 07 06:11:46 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:46 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:46 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" returned: 0 in 0.579s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 is being set with open permissions: ugo+rw Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:46 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 Apr 07 06:11:46 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.559s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:47 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" returned: 0 in 0.549s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:47 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info Apr 07 06:11:47 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:47 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info" returned: 0 in 0.528s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:47 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info is being set with open permissions: ugo+rw Apr 07 06:11:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:47 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info Apr 07 06:11:47 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:48 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.info" returned: 0 in 0.612s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.049s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.085s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2085346292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a8c780-c0b8-49ff-9187-8f3d4af93cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7e0c95c02f4881afaa1021cbd160e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:45Z,use_quota=True,user_id='1bc87f9ca7c34024a4594cc9483bcaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Creating volume 04a8c780-c0b8-49ff-9187-8f3d4af93cf4 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:48 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6dc8a0f1-397d-4033-bc36-4da4c643e09a tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Create snapshot completed successfully Apr 07 06:11:48 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 1073741824 Apr 07 06:11:48 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "cinder-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "cinder-quobyte-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Deleting offline snapshot f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 of volume 67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] snapshot_file for this snap is: volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772cb55-b9e0-47c5-89d6-2f5175a34ce8]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:49 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 Apr 07 06:11:49 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:49 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 1073741824" returned: 0 in 0.763s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:49 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 Apr 07 06:11:49 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:49 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" returned: 0 in 0.666s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f9228-1411-47f4-88b2-d92ab9811de6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:49 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b Apr 07 06:11:49 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:50 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" returned: 0 in 0.662s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35436562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e243a1-d87b-4a1c-b9cf-46d4b39d9745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:46Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume 10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:50 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e06ab1-8cac-41d3-ae58-547f6eb266f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a1c6bf-9759-4a38-aed2-7b6616ef6ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:50 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 1073741824 Apr 07 06:11:50 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Volume volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 (04a8c780-c0b8-49ff-9187-8f3d4af93cf4): created successfully Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a1c6bf-9759-4a38-aed2-7b6616ef6ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Flow 'volume_create_manager' (ced5ee6b-4a7b-4bda-8a45-95d5df817932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a640234a-8c8b-489f-92a7-80263b51c44c tempest-VolumesListAdminTestJSON-1192303666 None] Created volume successfully. Apr 07 06:11:50 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b" returned: 0 in 0.696s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 Apr 07 06:11:50 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:50 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 1073741824" returned: 0 in 0.808s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 Apr 07 06:11:50 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" returned: 0 in 0.846s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:51 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9 Apr 07 06:11:51 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Flow 'volume_create_manager' (fa166010-b1d0-4a82-b602-ffeefca7deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4963dd54-b220-4804-8a6c-de68468fb761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4963dd54-b220-4804-8a6c-de68468fb761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0fe891b46499fa0ee3a75fc8a6d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:51Z,use_quota=True,user_id='f00216629cb24194a420a6ee24064304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf34ab-e99c-4e91-a246-6db8906cd70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf34ab-e99c-4e91-a246-6db8906cd70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2683f4-b0b1-4ced-8211-13006ac1c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2683f4-b0b1-4ced-8211-13006ac1c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702', 'volume_name': 'volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a7653-c02e-480e-a7ed-006e21a1144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a7653-c02e-480e-a7ed-006e21a1144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be14f51a-31dd-49e8-8315-0a38fdbcc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Volume eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702', 'volume_size': 1} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:51 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" returned: 0 in 0.776s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0fe891b46499fa0ee3a75fc8a6d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:51Z,use_quota=True,user_id='f00216629cb24194a420a6ee24064304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Creating volume eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:51 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249d2e6a-b0b8-491c-979f-14451663c868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 1073741824 Apr 07 06:11:51 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67a62a4-3930-434e-953b-45060484d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 (10e243a1-d87b-4a1c-b9cf-46d4b39d9745): created successfully Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67a62a4-3930-434e-953b-45060484d59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (930dfa31-6049-44f9-b9b4-015bd8da75d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d29876e6-922a-4d86-a6fc-1599273d7eed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:11:51 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b.f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" returned: 0 in 0.557s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9" released by "_delete_snapshot" :: held 2.887s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" released by "delete_snapshot" :: held 2.905s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Created reservations ['1a403f3d-c164-4517-a200-ed9b42e2ab71', 'fec74c8c-1f44-4cfd-a41b-8c09c70e9cc5', 'e043caa8-51a8-4235-8146-c7c7e0f1e6b3', 'a3c32832-9dfc-40c7-b85f-53e98b9ce727'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Delete snapshot completed successfully. Apr 07 06:11:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3f199dfe-fd0c-4f52-a1f3-da951c6c59b4 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-f2cd1f6a-50d1-4e89-b71d-02f50e3ceca9-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "cinder-67faf62b-a6b6-4325-b1a9-81636e12dd3b-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-67faf62b-a6b6-4325-b1a9-81636e12dd3b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeacd3b-1c4d-4a6f-bc3c-eb35682c2824]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:52 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 1073741824" returned: 0 in 0.710s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:52 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 Apr 07 06:11:52 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:52 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b Apr 07 06:11:52 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:53 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b" returned: 0 in 0.704s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:53 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b Apr 07 06:11:53 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:53 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" returned: 0 in 0.674s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.467s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be14f51a-31dd-49e8-8315-0a38fdbcc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15ea5c3-097d-45ba-8a51-01a12f049589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating offline snapshot 9f45a4d5-8d2e-4f42-8512-d96cb5023941 of volume 10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:53 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Volume volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 (eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702): created successfully Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15ea5c3-097d-45ba-8a51-01a12f049589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Flow 'volume_create_manager' (fa166010-b1d0-4a82-b602-ffeefca7deb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37452a57-a6b4-40c8-b371-d25a1d0d3036]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f8f5fd1c-df85-4a3a-b870-24e30f34c322 tempest-VolumesListAdminTestJSON-2123427243 None] Created volume successfully. Apr 07 06:11:53 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 Apr 07 06:11:53 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:53 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-67faf62b-a6b6-4325-b1a9-81636e12dd3b" returned: 0 in 0.653s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-quobyte-67faf62b-a6b6-4325-b1a9-81636e12dd3b" released by "delete_volume" :: held 1.411s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Created reservations ['e9563f7f-f8a0-46ae-a427-4a967f42da36', '394354ba-721d-4bd0-b0f6-ff36c12d12f4', '49b0c783-1ee0-4fa0-b0f9-60ac5b2a698a', '55411f91-8313-483b-ba7d-69809b0083bd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Acquiring lock "cinder-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "cinder-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:53 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" returned: 0 in 0.744s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:53 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:53 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-04a8c780-c0b8-49ff-9187-8f3d4af93cf4-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:54 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 1G Apr 07 06:11:54 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Acquiring lock "cinder-quobyte-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-04a8c780-c0b8-49ff-9187-8f3d4af93cf4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "cinder-quobyte-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" acquired by "delete_volume" :: waited 0.025s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f735e-a46d-4fb5-b310-b5103126ccb2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-quobyte-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0aa738-1219-48dd-acad-0439b97cefad]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:54 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 Apr 07 06:11:54 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 Apr 07 06:11:54 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 1G" returned: 0 in 0.825s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:54 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:54 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.895s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Deleted volume successfully. Apr 07 06:11:54 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f1a546b-d76e-44f3-bb6c-a580e61a3af7 tempest-VolumesSnapshotNegativeTestJSON-1416207343 None] Lock "cinder-67faf62b-a6b6-4325-b1a9-81636e12dd3b-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:54 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" returned: 0 in 0.832s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:54 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702 Apr 07 06:11:54 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:55 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" returned: 0 in 1.048s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:55 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4 Apr 07 06:11:55 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:55 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941" returned: 0 in 0.966s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:55 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 is being set with open permissions: ugo+rw Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:55 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" returned: 0 in 0.870s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:55 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 Apr 07 06:11:55 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "cinder-quobyte-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702" released by "delete_volume" :: held 1.748s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Created reservations ['11005f96-b871-40a9-a6d4-12b118c7b2b0', 'af5e1317-a542-40a2-bb7d-90c2a9fd050f', '2ce1c4eb-66d5-4098-8ad5-822ba95200ec', '90425b7a-3fd2-4bad-97ee-a093461fefe6'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:55 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" returned: 0 in 0.716s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-04a8c780-c0b8-49ff-9187-8f3d4af93cf4" released by "delete_volume" :: held 1.804s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:56 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:56 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Created reservations ['206a089a-d025-48c5-a2ad-021f1452fcb3', '63f263a4-3489-4815-8e17-d594ec0f2dc8', '59ee4e07-3d55-4c8e-9898-414ab5c3fd66', 'e7b8a684-4861-4800-81d1-1bac70fea392'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:56 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:56 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b795fce-1e51-411e-99b4-bd9f9588d673 tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-85646423: creating Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-737a262a-edcd-4c0d-8066-d0176c530a13-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b795fce-1e51-411e-99b4-bd9f9588d673 tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-85646423: created successfully Apr 07 06:11:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b795fce-1e51-411e-99b4-bd9f9588d673 tempest-GroupSnapshotsTest-911934378 None] Create group completed successfully. Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-737a262a-edcd-4c0d-8066-d0176c530a13-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-quobyte-737a262a-edcd-4c0d-8066-d0176c530a13" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-737a262a-edcd-4c0d-8066-d0176c530a13" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84709de-b927-4c46-87ec-94d8d9c4a6cf]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:56 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 Apr 07 06:11:56 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:56 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941" returned: 0 in 0.935s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:56 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info Apr 07 06:11:56 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:56 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.938s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:56 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Deleted volume successfully. Apr 07 06:11:57 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.706s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-07369737-7631-4e95-b6d9-40b87253ea6d tempest-VolumesListAdminTestJSON-2123427243 None] Lock "cinder-eb0b22f9-5c0b-4d6d-b88c-fa05d3c60702-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Deleted volume successfully. Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1dc1e20d-e18e-4df7-ac03-e9aeaaff6577 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-04a8c780-c0b8-49ff-9187-8f3d4af93cf4-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:57 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info" returned: 0 in 0.591s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:57 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info is being set with open permissions: ugo+rw Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:57 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info Apr 07 06:11:57 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:57 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13" returned: 0 in 0.774s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:57 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13 Apr 07 06:11:57 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:57 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.info" returned: 0 in 0.656s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.843s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:57 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (28ad1977-153c-4b6d-b726-a919724709a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c14719-59e9-444e-ad4e-4acf508dd163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c14719-59e9-444e-ad4e-4acf508dd163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861246869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b588af35-121c-4aa1-8e65-c046498d1403,host='devstack@QuobyteHD#QuobyteHD',id=00bda985-8ad2-46ac-9366-b62ee6022f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:58Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66957099-6b8b-4f23-bf2d-9eb94c621037),volume_type_id=66957099-6b8b-4f23-bf2d-9eb94c621037)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12fc1a1-6d76-4b80-96a0-441efbcd23c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:58 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12fc1a1-6d76-4b80-96a0-441efbcd23c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4dd910-39d4-4a2c-b49c-462d3f1b3a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4dd910-39d4-4a2c-b49c-462d3f1b3a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bda985-8ad2-46ac-9366-b62ee6022f6a', 'volume_name': 'volume-00bda985-8ad2-46ac-9366-b62ee6022f6a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f26fd48-4ad6-41d4-9431-eaae524587dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f26fd48-4ad6-41d4-9431-eaae524587dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2e4894-d574-4f01-9abe-19e6b3ec2994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:58 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Volume 00bda985-8ad2-46ac-9366-b62ee6022f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bda985-8ad2-46ac-9366-b62ee6022f6a', 'volume_size': 1} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b588af35-121c-4aa1-8e65-c046498d1403,created_at=2026-04-07T04:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861246869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b588af35-121c-4aa1-8e65-c046498d1403,host='devstack@QuobyteHD#QuobyteHD',id=00bda985-8ad2-46ac-9366-b62ee6022f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:58Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66957099-6b8b-4f23-bf2d-9eb94c621037),volume_type_id=66957099-6b8b-4f23-bf2d-9eb94c621037)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Creating volume 00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:58 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-737a262a-edcd-4c0d-8066-d0176c530a13" returned: 0 in 0.734s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-75add18c-7614-4d45-aecc-0c48b463e8ce tempest-CreateVolumesFromSnapshotTest-1124400495 None] Create snapshot completed successfully Apr 07 06:11:58 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a 1073741824 Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-737a262a-edcd-4c0d-8066-d0176c530a13" released by "delete_volume" :: held 1.542s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:58 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Created reservations ['f9c86602-8d62-4bfb-a013-391d70cb68fa', '933e44bc-d43d-4e49-9474-a3e67a12cb25', 'a3584877-2e2e-45ac-a18d-989c297bdced', '77083c60-d87b-4c08-99e6-6e6ebe5e1b99'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:58 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:11:58 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-aee8e4bf-97a1-42a1-b682-c3728e63fa9a-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-aee8e4bf-97a1-42a1-b682-c3728e63fa9a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:58 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a 1073741824" returned: 0 in 0.812s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "cinder-quobyte-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" acquired by "delete_volume" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaa892-ba0f-488d-bf39-59bbbef8f381]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:58 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:11:58 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:59 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.790s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Deleted volume successfully. Apr 07 06:11:59 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a Apr 07 06:11:59 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-90155edf-5373-4258-b278-b691c917fdc6 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-737a262a-edcd-4c0d-8066-d0176c530a13-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (dbc4db4f-3a1a-4fca-99af-8a7128aaf293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed61fe-4dd4-4e36-af22-ee06190d1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed61fe-4dd4-4e36-af22-ee06190d1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468765645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d61ed71-bd94-4912-83f9-90ae4b96153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:59Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a24ed8-f9a5-471d-81df-b6a03fd3abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a24ed8-f9a5-471d-81df-b6a03fd3abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c015928-363b-46d7-8865-fa450695a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c015928-363b-46d7-8865-fa450695a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d61ed71-bd94-4912-83f9-90ae4b96153c', 'volume_name': 'volume-7d61ed71-bd94-4912-83f9-90ae4b96153c', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a88d95-f925-4618-a577-e3511ed41ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a88d95-f925-4618-a577-e3511ed41ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be31ba-533f-4909-b349-d2007233ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume 7d61ed71-bd94-4912-83f9-90ae4b96153c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d61ed71-bd94-4912-83f9-90ae4b96153c', 'volume_size': 1} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:59 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.672s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468765645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d61ed71-bd94-4912-83f9-90ae4b96153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:59Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume 7d61ed71-bd94-4912-83f9-90ae4b96153c {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2e4894-d574-4f01-9abe-19e6b3ec2994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bda985-8ad2-46ac-9366-b62ee6022f6a', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db515c93-f8d5-462a-b76f-1126f8455fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c 1073741824 Apr 07 06:11:59 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" returned: 0 in 0.742s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Volume volume-00bda985-8ad2-46ac-9366-b62ee6022f6a (00bda985-8ad2-46ac-9366-b62ee6022f6a): created successfully Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db515c93-f8d5-462a-b76f-1126f8455fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (28ad1977-153c-4b6d-b726-a919724709a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:59 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a Apr 07 06:11:59 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3ed91181-5525-4bdf-bb85-7bc2ed139375 tempest-GroupSnapshotsTest-911934378 None] Created volume successfully. Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (30f0e9d2-0099-4d73-95d9-924763eca13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8754af2c-9b11-49ac-9c34-2d458b608cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8754af2c-9b11-49ac-9c34-2d458b608cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419763666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b45cc67-8546-4c5e-ba7b-489cbeefeaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05476615-06dd-47fc-a3f3-3aded3cad513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05476615-06dd-47fc-a3f3-3aded3cad513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2a165e-30a4-4614-8054-0d2d649a0e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2a165e-30a4-4614-8054-0d2d649a0e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b45cc67-8546-4c5e-ba7b-489cbeefeaec', 'volume_name': 'volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409a0289-69d2-419a-8a37-e26dab54ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409a0289-69d2-419a-8a37-e26dab54ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47611e66-c3a1-4960-9944-7af324fd0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume 3b45cc67-8546-4c5e-ba7b-489cbeefeaec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec', 'volume_size': 1} Apr 07 06:11:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (ee1e5358-d830-470e-86fc-e3344a2f1eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3716eab3-1d20-48b3-b1b5-4c49286772c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3716eab3-1d20-48b3-b1b5-4c49286772c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716221985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d3974-7dc8-4ac3-9526-239bca6aabb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9085458-f28e-4f04-a8e5-61a553b29af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9085458-f28e-4f04-a8e5-61a553b29af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e82cd17-8559-43bf-b245-7e76a57108b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e82cd17-8559-43bf-b245-7e76a57108b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d3974-7dc8-4ac3-9526-239bca6aabb6', 'volume_name': 'volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eb9faf-dca0-4d34-8386-e1f863f23058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eb9faf-dca0-4d34-8386-e1f863f23058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d5257-fe59-49a6-9034-76830ed107b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume a01d3974-7dc8-4ac3-9526-239bca6aabb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6', 'volume_size': 1} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:00 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" returned: 0 in 0.751s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-quobyte-aee8e4bf-97a1-42a1-b682-c3728e63fa9a" released by "delete_volume" :: held 1.534s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:00 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c 1073741824" returned: 0 in 0.909s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Created reservations ['5a3d3bab-9aaa-4518-98e1-a0b468451d0d', '89030941-1a50-4b4b-9667-f7f14da31b49', '8852d42e-dd1c-4004-826f-18630cc0d575', '0b804d5a-16cd-4c9d-a7f6-22fcf879f184'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] GroupSnapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: creating. Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (26219365-1e4b-4202-94aa-65b67d40d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4dda23-46f0-48fd-abb4-6f87803d9645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:00 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:00 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4dda23-46f0-48fd-abb4-6f87803d9645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645257286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c54ff1e-b8f7-479a-ac6e-2846656c3a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145e2691-ca3b-4332-81b9-54b2bf02416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145e2691-ca3b-4332-81b9-54b2bf02416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05fa678-de6a-4b27-8632-6343113b1e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05fa678-de6a-4b27-8632-6343113b1e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c54ff1e-b8f7-479a-ac6e-2846656c3a35', 'volume_name': 'volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ca3a7b-95c2-4be6-b415-6d6800c59b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ca3a7b-95c2-4be6-b415-6d6800c59b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d163d74-544d-460e-9f53-e911935c6d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume 2c54ff1e-b8f7-479a-ac6e-2846656c3a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35', 'volume_size': 1} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Group snapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: creating. {{(pid=83450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:00 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c Apr 07 06:12:00 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (771b371a-9f2f-4f85-b8c0-5afa97634661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8787b1cf-1f38-4202-b66d-f245101402d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8787b1cf-1f38-4202-b66d-f245101402d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28505169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bfa9a3-cbf1-44c1-a56a-f4850237d34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:01Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d1ae6c-1e03-44a5-8aa0-d82a49d68918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d1ae6c-1e03-44a5-8aa0-d82a49d68918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f05a6e6-8fb7-4c70-91d0-75249e1e1243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f05a6e6-8fb7-4c70-91d0-75249e1e1243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bfa9a3-cbf1-44c1-a56a-f4850237d34f', 'volume_name': 'volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780e2e13-9aed-41dc-bd6b-dd7dbd3e5a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780e2e13-9aed-41dc-bd6b-dd7dbd3e5a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abe522a-21bb-4f69-be74-da99e5a76dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume 17bfa9a3-cbf1-44c1-a56a-f4850237d34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f', 'volume_size': 1} Apr 07 06:12:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:01 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Deleted volume successfully. Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-21392892-fc0a-4b09-a0f4-c2adda06bdd0 tempest-VolumesListAdminTestJSON-1192303666 None] Lock "cinder-aee8e4bf-97a1-42a1-b682-c3728e63fa9a-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:01 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c" returned: 0 in 0.668s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419763666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b45cc67-8546-4c5e-ba7b-489cbeefeaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume 3b45cc67-8546-4c5e-ba7b-489cbeefeaec {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:01 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be31ba-533f-4909-b349-d2007233ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d61ed71-bd94-4912-83f9-90ae4b96153c', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb8852d-b79c-45f5-8b6a-3f70c7b8bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:01 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec 1073741824 Apr 07 06:12:01 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:01 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-7d61ed71-bd94-4912-83f9-90ae4b96153c (7d61ed71-bd94-4912-83f9-90ae4b96153c): created successfully Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb8852d-b79c-45f5-8b6a-3f70c7b8bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (dbc4db4f-3a1a-4fca-99af-8a7128aaf293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-351b127e-7572-40e6-889e-365260623d81 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:12:02 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec 1073741824" returned: 0 in 0.708s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:02 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec Apr 07 06:12:02 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:02 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" returned: 0 in 0.578s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716221985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d3974-7dc8-4ac3-9526-239bca6aabb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume a01d3974-7dc8-4ac3-9526-239bca6aabb6 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:02 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:02 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 1073741824 Apr 07 06:12:02 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47611e66-c3a1-4960-9944-7af324fd0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0f5ed-a10a-482c-be5a-8790af8eba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:02 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec (3b45cc67-8546-4c5e-ba7b-489cbeefeaec): created successfully Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0f5ed-a10a-482c-be5a-8790af8eba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:02 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (30f0e9d2-0099-4d73-95d9-924763eca13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6d48b789-77de-437b-8ffe-de9d09bb30a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:12:03 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 1073741824" returned: 0 in 0.668s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:03 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 Apr 07 06:12:03 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:04 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6" returned: 0 in 0.559s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645257286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c54ff1e-b8f7-479a-ac6e-2846656c3a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume 2c54ff1e-b8f7-479a-ac6e-2846656c3a35 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:04 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d5257-fe59-49a6-9034-76830ed107b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248ead1a-444c-4fc6-bae4-d6c496b29adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:04 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 1073741824 Apr 07 06:12:04 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:04 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 (a01d3974-7dc8-4ac3-9526-239bca6aabb6): created successfully Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248ead1a-444c-4fc6-bae4-d6c496b29adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (ee1e5358-d830-470e-86fc-e3344a2f1eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-65826416-28ee-4056-8445-839f7dd5001c tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:12:04 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 1073741824" returned: 0 in 0.660s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:04 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 Apr 07 06:12:04 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:05 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" returned: 0 in 0.541s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.492s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d163d74-544d-460e-9f53-e911935c6d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6c1ed0-bdce-4837-bdaa-3e90e4d950ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Creating offline snapshot 317a41d3-4599-4fb7-ae04-7b418c4501f5 of volume 00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:05 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 (2c54ff1e-b8f7-479a-ac6e-2846656c3a35): created successfully Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6c1ed0-bdce-4837-bdaa-3e90e4d950ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (26219365-1e4b-4202-94aa-65b67d40d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e825aef-7cf6-4086-9182-fb674b7f09ed]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:05 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9ccd41ca-cb60-4eb1-92a0-24c7a046fff6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:12:05 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:05 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:06 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.630s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:06 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 1G Apr 07 06:12:06 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:06 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 1G" returned: 0 in 0.665s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bda985-8ad2-46ac-9366-b62ee6022f6a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:06 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bda985-8ad2-46ac-9366-b62ee6022f6a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:06 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bda985-8ad2-46ac-9366-b62ee6022f6a -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.635s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:07 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:07 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Flow 'volume_create_manager' (d8794de4-0928-4bf8-b398-1b17912fa075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c527e65f-4d99-48d4-be30-eac37505b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c527e65f-4d99-48d4-be30-eac37505b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1736338979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27aae16-6f0f-4f94-8eb3-35b461c388c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d9ef2bcd844b8d9e2dfdee6c16fc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:07Z,use_quota=True,user_id='f9d4f6591c41496abe2d642bd2ab6c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d35edc-4f68-4e06-a31e-1dda6ed2b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d35edc-4f68-4e06-a31e-1dda6ed2b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b92ca1-a132-4b5d-a182-adc8731d4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b92ca1-a132-4b5d-a182-adc8731d4edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27aae16-6f0f-4f94-8eb3-35b461c388c2', 'volume_name': 'volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cf6ec4-115d-4760-9b71-51b8be3c625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cf6ec4-115d-4760-9b71-51b8be3c625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b3198-6fba-4a09-9e0e-1b1906dde4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Volume b27aae16-6f0f-4f94-8eb3-35b461c388c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2', 'volume_size': 1} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:07 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.468s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info Apr 07 06:12:07 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:08 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:08 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info Apr 07 06:12:08 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.info" returned: 0 in 0.477s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.490s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.872s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28505169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bfa9a3-cbf1-44c1-a56a-f4850237d34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde801242fb4d77807dc5a81bb20cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:01Z,use_quota=True,user_id='a9740b3b013044c7888de23f93f91b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Creating volume 17bfa9a3-cbf1-44c1-a56a-f4850237d34f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:08 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:08 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f 1073741824 Apr 07 06:12:08 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dba484a8-4da0-4687-8dbf-2a46e754ccb0 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: created successfully Apr 07 06:12:09 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f 1073741824" returned: 0 in 0.579s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:09 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f Apr 07 06:12:09 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:09 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" returned: 0 in 0.489s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1736338979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27aae16-6f0f-4f94-8eb3-35b461c388c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d9ef2bcd844b8d9e2dfdee6c16fc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:07Z,use_quota=True,user_id='f9d4f6591c41496abe2d642bd2ab6c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Creating volume b27aae16-6f0f-4f94-8eb3-35b461c388c2 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:09 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abe522a-21bb-4f69-be74-da99e5a76dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7da0c2-2232-42a7-8eff-94b709925d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:09 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 1073741824 Apr 07 06:12:09 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Volume volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f (17bfa9a3-cbf1-44c1-a56a-f4850237d34f): created successfully Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7da0c2-2232-42a7-8eff-94b709925d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Flow 'volume_create_manager' (771b371a-9f2f-4f85-b8c0-5afa97634661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:10 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6ddd4935-a8d5-43e1-86c6-2317787ef7a6 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created volume successfully. Apr 07 06:12:10 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 1073741824" returned: 0 in 0.557s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:10 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 Apr 07 06:12:10 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-17bfa9a3-cbf1-44c1-a56a-f4850237d34f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-17bfa9a3-cbf1-44c1-a56a-f4850237d34f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff69e1-b0e8-4870-8614-b2cc1a488e84]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:10 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f Apr 07 06:12:10 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2" returned: 0 in 0.576s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.125s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5-8506713e-a533-4af4-9f36-899ee7d3f8b8" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b3198-6fba-4a09-9e0e-1b1906dde4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c2d408-c813-479e-b1f1-994b19dfc3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5-8506713e-a533-4af4-9f36-899ee7d3f8b8" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Creating volume 8506713e-a533-4af4-9f36-899ee7d3f8b8 from snapshot 317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] snapshot: 317a41d3-4599-4fb7-ae04-7b418c4501f5, volume: 8506713e-a533-4af4-9f36-899ee7d3f8b8, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Volume volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 (b27aae16-6f0f-4f94-8eb3-35b461c388c2): created successfully Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c2d408-c813-479e-b1f1-994b19dfc3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Flow 'volume_create_manager' (d8794de4-0928-4bf8-b398-1b17912fa075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75996a0c-e491-48d4-94ea-45843faef7a3]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d83f4f89-f6f1-4a66-af2a-98de816df6cf tempest-AbsoluteLimitsTests-425433717 None] Created volume successfully. Apr 07 06:12:11 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:11 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" returned: 0 in 0.564s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f Apr 07 06:12:11 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00bda985-8ad2-46ac-9366-b62ee6022f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6a774-2ab5-4c68-9edc-00f8d5bd41b1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Acquiring lock "cinder-b27aae16-6f0f-4f94-8eb3-35b461c388c2-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "cinder-b27aae16-6f0f-4f94-8eb3-35b461c388c2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Acquiring lock "cinder-quobyte-b27aae16-6f0f-4f94-8eb3-35b461c388c2" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "cinder-quobyte-b27aae16-6f0f-4f94-8eb3-35b461c388c2" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ef48f-5745-4bca-9f68-eda97d126051]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:11 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 Apr 07 06:12:11 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" returned: 0 in 0.530s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-17bfa9a3-cbf1-44c1-a56a-f4850237d34f" released by "delete_volume" :: held 1.127s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['68511544-1b7c-48a9-8a25-2ceecdd95e98', '7c301ff8-1aef-449c-a192-a85eee6a182e', 'd1c168f6-80fc-482f-b1e9-326ae7c8fc57', '23374274-d449-460d-b26e-b452c22125d2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:12 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:12 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:12 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.622s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:12 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 Apr 07 06:12:12 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:12 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2" returned: 0 in 0.612s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:12 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2 Apr 07 06:12:12 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:12 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.484s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:12 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a48443c0-af7b-438a-becc-2f651e503cbf tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-17bfa9a3-cbf1-44c1-a56a-f4850237d34f-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:12 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b27aae16-6f0f-4f94-8eb3-35b461c388c2" returned: 0 in 0.518s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:12 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "cinder-quobyte-b27aae16-6f0f-4f94-8eb3-35b461c388c2" released by "delete_volume" :: held 1.157s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-2c54ff1e-b8f7-479a-ac6e-2846656c3a35-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-2c54ff1e-b8f7-479a-ac6e-2846656c3a35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Created reservations ['928df8a7-266e-412e-84fc-61b1804dcb77', 'ae1190c7-9e52-4a5a-98a1-0eca45699355', '7e140b48-6064-4c8a-8098-8d32d4ccfeb4', '90321ae6-1af5-4eca-8e34-93a0561b6deb'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" acquired by "delete_volume" :: waited 0.059s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adecd3f-5460-4a97-bee2-91dffc20d9c6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:13 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 Apr 07 06:12:13 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:13 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:13 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:14 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 1.376s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:14 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Deleted volume successfully. Apr 07 06:12:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4eecefd9-f76e-4fdc-8b73-69bc7eda351f tempest-AbsoluteLimitsTests-425433717 None] Lock "cinder-b27aae16-6f0f-4f94-8eb3-35b461c388c2-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:15 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" returned: 0 in 2.154s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:15 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35 Apr 07 06:12:15 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:15 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8" returned: 0 in 3.024s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f9248-e6cb-44ff-894e-42557fd08376]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:15 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:15 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:15 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" returned: 0 in 0.679s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-2c54ff1e-b8f7-479a-ac6e-2846656c3a35" released by "delete_volume" :: held 2.881s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['58521d35-47f0-40f4-828b-8ad794a48119', '18219c34-3af7-4423-b58a-3e39cbadcac5', 'aa286184-12fc-4ea7-83d0-51221c1b4834', '84814a29-b88a-4060-8efa-4d4443f1f584'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:16 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:16 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:16 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.976s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a, size 1024.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:12:16 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Converted 1024.00 MB image at 338.47 MB/s Apr 07 06:12:16 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:16 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 Apr 07 06:12:16 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-a01d3974-7dc8-4ac3-9526-239bca6aabb6-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-a01d3974-7dc8-4ac3-9526-239bca6aabb6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-a01d3974-7dc8-4ac3-9526-239bca6aabb6" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-a01d3974-7dc8-4ac3-9526-239bca6aabb6" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e4a69-2ee3-4748-ab58-4c98729d5eca]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:16 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 Apr 07 06:12:16 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:16 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.841s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a2da2907-f9b8-452a-94ce-01d564c22e4d tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-2c54ff1e-b8f7-479a-ac6e-2846656c3a35-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:17 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8" returned: 0 in 0.794s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" released by "_copy_volume_from_snapshot" :: held 6.037s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5-8506713e-a533-4af4-9f36-899ee7d3f8b8" released by "_create_volume_from_snapshot" :: held 6.064s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.092s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1edecfcd-3fae-4dbf-9870-14a75a10b029 tempest-GroupSnapshotsTest-911934378 None] Create group from source-snapshot-76f3038a-cb6a-416c-91ab-d8a32f254365 completed successfully. Apr 07 06:12:17 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6" returned: 0 in 0.937s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:17 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6 Apr 07 06:12:17 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:18 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a01d3974-7dc8-4ac3-9526-239bca6aabb6" returned: 0 in 0.662s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-a01d3974-7dc8-4ac3-9526-239bca6aabb6" released by "delete_volume" :: held 1.648s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['be2947a0-4b76-44e1-a2ab-e011859454de', '33ee1b25-b073-4491-9eaa-5c63a211ce7f', '647b9614-6dce-4e71-90c0-7e430e46f98e', '7864215e-1983-49b4-b52c-871ad695bd83'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc635cc8-2fd3-4e6a-93bc-67cf83068288]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:18 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:18 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:18 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 Apr 07 06:12:18 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-3b45cc67-8546-4c5e-ba7b-489cbeefeaec-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-3b45cc67-8546-4c5e-ba7b-489cbeefeaec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35fe0b4-f827-471f-9925-c127358356b9]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:19 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec Apr 07 06:12:19 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:19 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.642s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:19 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4b8f57db-bef1-4a07-802b-ac5349e92345 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-a01d3974-7dc8-4ac3-9526-239bca6aabb6-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:19 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8" returned: 0 in 0.697s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:19 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8 Apr 07 06:12:19 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:19 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" returned: 0 in 0.641s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:19 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec Apr 07 06:12:19 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:19 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8506713e-a533-4af4-9f36-899ee7d3f8b8" returned: 0 in 0.553s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-8506713e-a533-4af4-9f36-899ee7d3f8b8" released by "delete_volume" :: held 1.297s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Created reservations ['0a3120c4-54a7-4473-95cc-21d4d7eb8755'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:19 devstack cinder-volume[83450]: WARNING cinder.quota [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-838753983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-838753983, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:19 devstack cinder-volume[83450]: WARNING cinder.quota [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-838753983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-838753983, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Created reservations ['8ef091e3-6181-46f1-8ba8-b5951b1e6aa3', '2a768bbb-e6e3-4a59-be84-6fdbf3671ddd', 'ddb42290-7ee0-43b5-8da7-e07ac2c35dee', '14b9f198-250c-48f0-80c3-2be4df1af57a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:19 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:19 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:20 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" returned: 0 in 0.596s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-3b45cc67-8546-4c5e-ba7b-489cbeefeaec" released by "delete_volume" :: held 1.271s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['cdc917ce-2a64-4d07-b6bc-d900f3e018b6', 'd15bbe0e-c982-4eeb-bf39-017ec22a6a87', 'ab86f69c-4c66-42c1-a404-bb0c807a3cac', 'bc898ca9-b639-43de-8eb4-c51278a28e06'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:20 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:20 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:20 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.552s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-33f73038-91b2-46f9-acc5-5868c6e7c2bd tempest-GroupSnapshotsTest-911934378 None] Delete group completed successfully. Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Flow 'volume_create_manager' (7095edf5-7f9a-457a-8aa4-93f033e0a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31d6044-d0f3-4531-879f-945c1f050600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31d6044-d0f3-4531-879f-945c1f050600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-168757255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e8c681-213e-4e23-b3d2-e1903e93921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece5810924644a0b408eba47bdddf40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:21Z,use_quota=True,user_id='41ca8e52d9dd4bea94f5389d55adc528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ac8bac-5121-43cc-9f60-c942856b706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ac8bac-5121-43cc-9f60-c942856b706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c23677-0084-4a17-a09b-aa29cf07af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c23677-0084-4a17-a09b-aa29cf07af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e8c681-213e-4e23-b3d2-e1903e93921e', 'volume_name': 'volume-40e8c681-213e-4e23-b3d2-e1903e93921e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59748bc1-4864-4015-8a6e-9dc03f9366e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59748bc1-4864-4015-8a6e-9dc03f9366e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbe9933-71ac-4c4e-b107-54c9bace62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Volume 40e8c681-213e-4e23-b3d2-e1903e93921e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e8c681-213e-4e23-b3d2-e1903e93921e', 'volume_size': 1} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-168757255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e8c681-213e-4e23-b3d2-e1903e93921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece5810924644a0b408eba47bdddf40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:21Z,use_quota=True,user_id='41ca8e52d9dd4bea94f5389d55adc528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Creating volume 40e8c681-213e-4e23-b3d2-e1903e93921e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:20 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: deleting Apr 07 06:12:20 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e 1073741824 Apr 07 06:12:20 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: deleting {{(pid=83450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Deleting offline snapshot 317a41d3-4599-4fb7-ae04-7b418c4501f5 of volume 00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] snapshot_file for this snap is: volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[00faef32-fe09-46b5-9256-04d2d62a8c90]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:20 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a291a8db-0341-498a-b0de-ff0a2e6e1f62 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-3b45cc67-8546-4c5e-ba7b-489cbeefeaec-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:20 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:20 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-7d61ed71-bd94-4912-83f9-90ae4b96153c-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-7d61ed71-bd94-4912-83f9-90ae4b96153c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-7d61ed71-bd94-4912-83f9-90ae4b96153c" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-7d61ed71-bd94-4912-83f9-90ae4b96153c" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262febb-99ba-4949-bb93-09b89d547ad8]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c Apr 07 06:12:21 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e 1073741824" returned: 0 in 0.623s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e Apr 07 06:12:21 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.630s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00bda985-8ad2-46ac-9366-b62ee6022f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4850063e-12a6-4b73-92b4-ac16140db585]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:21 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c" returned: 0 in 0.643s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e" returned: 0 in 0.477s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:21 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c Apr 07 06:12:21 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbe9933-71ac-4c4e-b107-54c9bace62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e8c681-213e-4e23-b3d2-e1903e93921e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae64097-5dfe-40a7-a2c0-dfda27c17b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Volume volume-40e8c681-213e-4e23-b3d2-e1903e93921e (40e8c681-213e-4e23-b3d2-e1903e93921e): created successfully Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae64097-5dfe-40a7-a2c0-dfda27c17b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Flow 'volume_create_manager' (7095edf5-7f9a-457a-8aa4-93f033e0a341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:21 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2f3cefeb-d120-4eaf-b455-84790ec0648a tempest-VolumesTransfersTest-1148452137 None] Created volume successfully. Apr 07 06:12:22 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.628s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:22 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-7d61ed71-bd94-4912-83f9-90ae4b96153c" returned: 0 in 0.551s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-7d61ed71-bd94-4912-83f9-90ae4b96153c" released by "delete_volume" :: held 1.218s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['13cf8ee0-a9e4-481a-9795-f0f03a6ec670', 'b0b2b9ee-f5b8-4ed3-9bc6-132ad0497a7b', 'bc836a9f-d74a-4e88-940e-400046791305', '8f682102-ef58-49f1-a496-dd39b751cbee'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:22 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.599s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5 Apr 07 06:12:22 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:23 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:23 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4e11d2d5-f7f0-49a6-b059-9f84079316ed tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-7d61ed71-bd94-4912-83f9-90ae4b96153c-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:23 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a.317a41d3-4599-4fb7-ae04-7b418c4501f5" returned: 0 in 0.516s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-317a41d3-4599-4fb7-ae04-7b418c4501f5" released by "_delete_snapshot" :: held 2.427s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" released by "delete_snapshot" :: held 2.444s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-9f45a4d5-8d2e-4f42-8512-d96cb5023941-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:23 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-921cd6cf-9c87-46a1-b3b5-308c524158c5 tempest-VolumesTransfersTest-1767831436 None] Transfer volume completed successfully. Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-9f45a4d5-8d2e-4f42-8512-d96cb5023941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:23 devstack cinder-volume[83450]: WARNING cinder.quota [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-838753983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-838753983, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['2a8be121-6f12-4c4a-aa18-b8a4edc8c2c9', 'c5b46ebd-3397-4e2a-8251-049fd49d33f0', 'd41e9100-2f05-40ce-92a8-1f77c87f3905', 'e1c8321c-8565-4d74-8715-45050be18244'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-9f45a4d5-8d2e-4f42-8512-d96cb5023941" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-9f45a4d5-8d2e-4f42-8512-d96cb5023941" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleting offline snapshot 9f45a4d5-8d2e-4f42-8512-d96cb5023941 of volume 10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] snapshot_file for this snap is: volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[389993a0-c3e7-4cf1-87e6-fd9d2e1517ad]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:23 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4bc6bf35-2ecd-4f70-9ace-ed28ef06e482 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 76f3038a-cb6a-416c-91ab-d8a32f254365: deleted successfully Apr 07 06:12:23 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 Apr 07 06:12:23 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941" returned: 0 in 0.626s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab223d-2d9b-4663-a95e-2606d38c7492]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 Apr 07 06:12:24 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" acquired by "delete_volume" :: waited 0.023s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Acquiring lock "cinder-40e8c681-213e-4e23-b3d2-e1903e93921e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aedfdd6-cc7d-4dd0-87c4-253aae8fb61a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "cinder-40e8c681-213e-4e23-b3d2-e1903e93921e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Acquiring lock "cinder-quobyte-40e8c681-213e-4e23-b3d2-e1903e93921e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "cinder-quobyte-40e8c681-213e-4e23-b3d2-e1903e93921e" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03491fe4-eb65-4ba7-b8f3-279869e84bd7]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:24 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e Apr 07 06:12:24 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" returned: 0 in 0.619s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 Apr 07 06:12:24 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.591s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a Apr 07 06:12:24 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e Apr 07 06:12:24 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:25 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941" returned: 0 in 0.523s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:25 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941 Apr 07 06:12:25 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:25 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-00bda985-8ad2-46ac-9366-b62ee6022f6a" returned: 0 in 0.488s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-00bda985-8ad2-46ac-9366-b62ee6022f6a" released by "delete_volume" :: held 1.130s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['a4fdb211-3e40-4168-b579-ffc4471dafd9'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:25 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-40e8c681-213e-4e23-b3d2-e1903e93921e" returned: 0 in 0.554s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[83450]: WARNING cinder.db.sqlalchemy.api [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-838753983'] Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "cinder-quobyte-40e8c681-213e-4e23-b3d2-e1903e93921e" released by "delete_volume" :: held 1.126s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['a5d6c1e4-f933-4ac1-8e11-dd079f3092fb', '14cd1f0a-76cf-46f5-a134-08a0eb841bf4', '5155a08c-15a6-4ecd-936e-64b5e01d50dc', 'c06bb7da-c45e-4ae2-8bc6-6444c97fb70c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Created reservations ['69c70963-ba5f-483c-9e22-41f48abee9e3', '9929d88e-c1bd-46e9-b74b-dcd0df82de57', '0ef891d0-2ad5-4e37-8a98-13c0886d31e4', 'e833370d-721b-4f68-832a-9720cafb27a3'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:25 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:25 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:25 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:25 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:25 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745.9f45a4d5-8d2e-4f42-8512-d96cb5023941" returned: 0 in 0.505s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-9f45a4d5-8d2e-4f42-8512-d96cb5023941" released by "_delete_snapshot" :: held 2.370s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" released by "delete_snapshot" :: held 2.389s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['902420ac-6b3d-48f6-92af-c87a6a9fc14f', '16d4c1b4-37a6-45ed-b6a1-c0933ee6d1d5', '4e0c912a-2f80-46c4-9887-cd7df237d9b9', '85c8e5c2-90a5-474d-9042-0060bf0cf7e8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Delete snapshot completed successfully. Apr 07 06:12:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-889f68b9-28a8-4757-9a86-af1f6d7fda54 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-9f45a4d5-8d2e-4f42-8512-d96cb5023941-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:26 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.479s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e2826cac-8ebd-40c7-b98e-c737190ff074 tempest-GroupSnapshotsTest-911934378 None] Delete group completed successfully. Apr 07 06:12:26 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Deleted volume successfully. Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-415756b6-85e4-4e6d-ae98-cb09d01dcf81 tempest-VolumesTransfersTest-765804750 None] Lock "cinder-40e8c681-213e-4e23-b3d2-e1903e93921e-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-10e243a1-d87b-4a1c-b9cf-46d4b39d9745-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-10e243a1-d87b-4a1c-b9cf-46d4b39d9745-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[238add16-b044-49eb-beb8-7632c4247332]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:26 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 Apr 07 06:12:26 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4d79f9fe-39d1-4fcb-b2e7-81e0b8cf7552 tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-887271919: creating Apr 07 06:12:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4d79f9fe-39d1-4fcb-b2e7-81e0b8cf7552 tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-887271919: created successfully Apr 07 06:12:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4d79f9fe-39d1-4fcb-b2e7-81e0b8cf7552 tempest-GroupSnapshotsTest-911934378 None] Create group completed successfully. Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Flow 'volume_create_manager' (fb063dbc-4e1f-4942-a8e1-0999d3c551b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326e8fb7-b104-4e9b-b31e-69e0dbe82b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326e8fb7-b104-4e9b-b31e-69e0dbe82b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-516258501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc41e07e-f1fb-4caf-8d4e-d00093d1de61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece5810924644a0b408eba47bdddf40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='41ca8e52d9dd4bea94f5389d55adc528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7f59ad-e250-4947-8035-63b74d2dad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7f59ad-e250-4947-8035-63b74d2dad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f520cce-cb17-4e0b-96e1-b1ba2946e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f520cce-cb17-4e0b-96e1-b1ba2946e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc41e07e-f1fb-4caf-8d4e-d00093d1de61', 'volume_name': 'volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8b0e50-41a1-42d9-b1d6-b1802a9c25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8b0e50-41a1-42d9-b1d6-b1802a9c25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b172c6-e8a9-4b94-9f83-a3fbef470c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Volume cc41e07e-f1fb-4caf-8d4e-d00093d1de61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61', 'volume_size': 1} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-516258501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc41e07e-f1fb-4caf-8d4e-d00093d1de61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece5810924644a0b408eba47bdddf40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='41ca8e52d9dd4bea94f5389d55adc528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Creating volume cc41e07e-f1fb-4caf-8d4e-d00093d1de61 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:27 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 1073741824 Apr 07 06:12:27 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:27 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" returned: 0 in 0.628s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745 Apr 07 06:12:27 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:27 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 1073741824" returned: 0 in 0.586s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 Apr 07 06:12:27 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:27 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-quobyte-10e243a1-d87b-4a1c-b9cf-46d4b39d9745" released by "delete_volume" :: held 1.160s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Created reservations ['673e65a8-528b-43f3-9f17-c234b890234e', 'd44735bc-4f8e-48ce-9cfc-033877455f06', 'bb33db31-60e6-4420-9595-d6502785e5ca', '71185a79-f9ed-4dbd-b321-8923818bf9a2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:27 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (f1496fa6-c7f1-4b81-ae58-c7b750461d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f609dbb0-e979-40ab-9518-7e773eba9217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" returned: 0 in 0.652s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f609dbb0-e979-40ab-9518-7e773eba9217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-95903135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,host='devstack@QuobyteHD#QuobyteHD',id=1cc9edd0-f043-40df-894b-b65570d8b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:28Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5201e99d-3744-4474-b289-33c587f6c81e),volume_type_id=5201e99d-3744-4474-b289-33c587f6c81e)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39400b-e9cb-465e-be8e-aafe4a677be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39400b-e9cb-465e-be8e-aafe4a677be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed14391a-7b04-4ffe-ab01-c0e0dedc8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed14391a-7b04-4ffe-ab01-c0e0dedc8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc9edd0-f043-40df-894b-b65570d8b97b', 'volume_name': 'volume-1cc9edd0-f043-40df-894b-b65570d8b97b', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d75cf-e75e-4397-be4a-9c09ff96c0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d75cf-e75e-4397-be4a-9c09ff96c0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17282794-e389-4038-89a2-e8227152b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Volume 1cc9edd0-f043-40df-894b-b65570d8b97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc9edd0-f043-40df-894b-b65570d8b97b', 'volume_size': 1} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,created_at=2026-04-07T04:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-95903135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,host='devstack@QuobyteHD#QuobyteHD',id=1cc9edd0-f043-40df-894b-b65570d8b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:28Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5201e99d-3744-4474-b289-33c587f6c81e),volume_type_id=5201e99d-3744-4474-b289-33c587f6c81e)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Creating volume 1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:28 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:28 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.568s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:28 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b 1073741824 Apr 07 06:12:28 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b172c6-e8a9-4b94-9f83-a3fbef470c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54d8687-abc4-42af-99d4-dc472b2aa38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:28 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Deleted volume successfully. Apr 07 06:12:28 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Volume volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 (cc41e07e-f1fb-4caf-8d4e-d00093d1de61): created successfully Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54d8687-abc4-42af-99d4-dc472b2aa38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Flow 'volume_create_manager' (fb063dbc-4e1f-4942-a8e1-0999d3c551b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:28 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dc574e02-de80-46d8-9592-da992e00f0a8 tempest-VolumesTransfersTest-1148452137 None] Created volume successfully. Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f7fc41c-bf8d-4cc2-a113-a6b2eb3eb723 tempest-CreateVolumesFromSnapshotTest-1124400495 None] Lock "cinder-10e243a1-d87b-4a1c-b9cf-46d4b39d9745-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:28 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b 1073741824" returned: 0 in 0.593s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:29 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b Apr 07 06:12:29 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Acquiring lock "cinder-cc41e07e-f1fb-4caf-8d4e-d00093d1de61-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "cinder-cc41e07e-f1fb-4caf-8d4e-d00093d1de61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Acquiring lock "cinder-quobyte-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "cinder-quobyte-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb21548-cee2-4b44-be79-ec1b3f42dc78]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:29 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 Apr 07 06:12:29 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b" returned: 0 in 0.618s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17282794-e389-4038-89a2-e8227152b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc9edd0-f043-40df-894b-b65570d8b97b', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ff4935-d725-4ca5-9c79-1deb2257f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:29 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Volume volume-1cc9edd0-f043-40df-894b-b65570d8b97b (1cc9edd0-f043-40df-894b-b65570d8b97b): created successfully Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ff4935-d725-4ca5-9c79-1deb2257f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (f1496fa6-c7f1-4b81-ae58-c7b750461d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-6dc17254-6f6e-40f7-bd11-db28ca8c2f64 tempest-GroupSnapshotsTest-911934378 None] Created volume successfully. Apr 07 06:12:30 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" returned: 0 in 0.621s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:30 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61 Apr 07 06:12:30 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:30 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" returned: 0 in 0.540s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "cinder-quobyte-cc41e07e-f1fb-4caf-8d4e-d00093d1de61" released by "delete_volume" :: held 1.207s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Created reservations ['d15c054c-fa1a-4ff3-8628-2aaab1399987', 'cc3e850f-824f-4e3d-998e-24dd95f90b63', 'f8974dac-c1b5-4331-b690-8935fb15a1d5', 'c51d218e-0b6a-492e-85ad-64052eea6574'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:30 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:30 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (1234fae0-dad8-4246-8903-9890c624f12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43cd71d-739f-486f-909b-06d75eda19b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43cd71d-739f-486f-909b-06d75eda19b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1792946196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,host='devstack@QuobyteHD#QuobyteHD',id=d43858d1-1a50-4eed-86a6-d784da7b0642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:31Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5201e99d-3744-4474-b289-33c587f6c81e),volume_type_id=5201e99d-3744-4474-b289-33c587f6c81e)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b54817-8f9d-47b3-a713-2b320a664ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b54817-8f9d-47b3-a713-2b320a664ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea3f937-9810-443a-a920-079f21b08275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea3f937-9810-443a-a920-079f21b08275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43858d1-1a50-4eed-86a6-d784da7b0642', 'volume_name': 'volume-d43858d1-1a50-4eed-86a6-d784da7b0642', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44a9bd3-6ad2-4333-ae26-39f002d71f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44a9bd3-6ad2-4333-ae26-39f002d71f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041771ea-b8e9-4c0a-b77c-be3d27e19c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Volume d43858d1-1a50-4eed-86a6-d784da7b0642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43858d1-1a50-4eed-86a6-d784da7b0642', 'volume_size': 1} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,created_at=2026-04-07T04:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1792946196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd371aa-8047-4aa1-abbd-8ece82f28f5a,host='devstack@QuobyteHD#QuobyteHD',id=d43858d1-1a50-4eed-86a6-d784da7b0642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:31Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5201e99d-3744-4474-b289-33c587f6c81e),volume_type_id=5201e99d-3744-4474-b289-33c587f6c81e)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Creating volume d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:30 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:30 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 1073741824 Apr 07 06:12:30 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:31 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.488s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:31 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:31 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Deleted volume successfully. Apr 07 06:12:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-09f4c4ef-5114-4739-9941-bd6cfb0f7d0f tempest-VolumesTransfersTest-765804750 None] Lock "cinder-cc41e07e-f1fb-4caf-8d4e-d00093d1de61-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:31 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 1073741824" returned: 0 in 0.618s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:31 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 Apr 07 06:12:31 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:32 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642" returned: 0 in 0.502s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041771ea-b8e9-4c0a-b77c-be3d27e19c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43858d1-1a50-4eed-86a6-d784da7b0642', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcbd56f-43c3-4d40-80b3-1427cc2167f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Volume volume-d43858d1-1a50-4eed-86a6-d784da7b0642 (d43858d1-1a50-4eed-86a6-d784da7b0642): created successfully Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcbd56f-43c3-4d40-80b3-1427cc2167f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (1234fae0-dad8-4246-8903-9890c624f12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:32 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-db2e121e-5032-45c5-a80a-5a6cdabff9f1 tempest-GroupSnapshotsTest-911934378 None] Created volume successfully. Apr 07 06:12:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7eed5d2f-e9c1-4f69-ad25-a75c069be41d tempest-GroupSnapshotsTest-911934378 None] Update group completed successfully. Apr 07 06:12:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-53123404-49a9-48bd-9bfc-e0729c9d6701 tempest-GroupSnapshotsTest-911934378 None] Update group completed successfully. Apr 07 06:12:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f9eb8a0f-201a-4273-961d-e4b4a51b2edd tempest-GroupSnapshotsTest-911934378 None] Update group completed successfully. Apr 07 06:12:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2a10450b-3013-4338-8b22-effc0eb1ee8b tempest-GroupSnapshotsTest-911934378 None] Update group completed successfully. Apr 07 06:12:37 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] GroupSnapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: creating. Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Group snapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: creating. {{(pid=83450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Creating offline snapshot 810e34bb-9378-4f31-bd11-b4e71dbe2f70 of volume 1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc238fc-0edb-4a9c-808b-5bfde3b37e73]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b Apr 07 06:12:38 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b" returned: 0 in 0.598s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 1G Apr 07 06:12:38 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 1G" returned: 0 in 0.691s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc9edd0-f043-40df-894b-b65570d8b97b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc9edd0-f043-40df-894b-b65570d8b97b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 Apr 07 06:12:39 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc9edd0-f043-40df-894b-b65570d8b97b -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70" returned: 0 in 0.674s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 Apr 07 06:12:39 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:40 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:40 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info Apr 07 06:12:40 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:41 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info" returned: 0 in 0.540s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:41 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:41 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info Apr 07 06:12:41 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:41 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.info" returned: 0 in 0.540s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.653s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Creating offline snapshot a8b49351-7bda-44a0-b2e2-05f215f90c26 of volume d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508d74c-3be0-4f83-a03a-3d9fc350a96d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:41 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 Apr 07 06:12:41 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642" returned: 0 in 0.617s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 1G Apr 07 06:12:42 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 1G" returned: 0 in 0.554s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43858d1-1a50-4eed-86a6-d784da7b0642 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43858d1-1a50-4eed-86a6-d784da7b0642 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 Apr 07 06:12:42 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:43 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43858d1-1a50-4eed-86a6-d784da7b0642 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26" returned: 0 in 0.567s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:43 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:43 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 Apr 07 06:12:43 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:43 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26" returned: 0 in 0.622s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:44 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info Apr 07 06:12:44 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:44 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:44 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info Apr 07 06:12:44 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=202,cinder:SELECT=160,cinder:INSERT=44,cinder:DELETE=16 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Flow 'volume_create_manager' (fcc8b5a8-cbc8-43ae-8eaa-84037ee11e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5a370-8ee5-4331-8baf-cd58ccfad008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=177,cinder:UPDATE=210,cinder:DELETE=15,cinder:INSERT=53 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5a370-8ee5-4331-8baf-cd58ccfad008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1022541392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fccc63937f4e5ba2a67a8b4eda0cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:45Z,use_quota=True,user_id='736273bae42f4a8aa84161ecb78c9247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52ad6c-662d-44aa-974b-5fb66539a6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52ad6c-662d-44aa-974b-5fb66539a6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0658f6dc-45df-4a31-a1b6-e563287d1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0658f6dc-45df-4a31-a1b6-e563287d1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2', 'volume_name': 'volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f07362-6830-41c2-b507-a45e7409f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f07362-6830-41c2-b507-a45e7409f296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22adfce5-0bfb-421f-bcaa-2c39e93edd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:44 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2', 'volume_size': 1} Apr 07 06:12:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:45 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.info" returned: 0 in 0.509s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.436s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1022541392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fccc63937f4e5ba2a67a8b4eda0cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:45Z,use_quota=True,user_id='736273bae42f4a8aa84161ecb78c9247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Creating volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:45 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 1073741824 Apr 07 06:12:45 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9e666dc5-0d1d-47ba-97fe-a654830cc701 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: created successfully Apr 07 06:12:45 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: deleting Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: deleting {{(pid=83450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-810e34bb-9378-4f31-bd11-b4e71dbe2f70" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-810e34bb-9378-4f31-bd11-b4e71dbe2f70" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Deleting offline snapshot 810e34bb-9378-4f31-bd11-b4e71dbe2f70 of volume 1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] snapshot_file for this snap is: volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[017bae47-1864-4852-bac5-5cb026c59c96]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 Apr 07 06:12:45 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 1073741824" returned: 0 in 0.749s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:12:45 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70" returned: 0 in 0.572s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc9edd0-f043-40df-894b-b65570d8b97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee61af-9ee7-4c19-a21b-eed820ac555f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b Apr 07 06:12:46 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22adfce5-0bfb-421f-bcaa-2c39e93edd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c881deb-54db-4799-9846-58b33537c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:46 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:46 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Volume volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 (5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2): created successfully Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c881deb-54db-4799-9846-58b33537c15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Flow 'volume_create_manager' (fcc8b5a8-cbc8-43ae-8eaa-84037ee11e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d78538ac-efa2-4ce1-b34b-2352e8143aab tempest-VolumesActionsTest-41510837 None] Created volume successfully. Apr 07 06:12:46 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b" returned: 0 in 0.664s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 Apr 07 06:12:46 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.563s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:47 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70" returned: 0 in 0.609s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:47 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70 Apr 07 06:12:47 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b.810e34bb-9378-4f31-bd11-b4e71dbe2f70" returned: 0 in 0.514s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-810e34bb-9378-4f31-bd11-b4e71dbe2f70" released by "_delete_snapshot" :: held 2.449s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" released by "delete_snapshot" :: held 2.466s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-a8b49351-7bda-44a0-b2e2-05f215f90c26" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-a8b49351-7bda-44a0-b2e2-05f215f90c26" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Deleting offline snapshot a8b49351-7bda-44a0-b2e2-05f215f90c26 of volume d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] snapshot_file for this snap is: volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa02eb3-14cb-4f0d-a54c-875ffbef8260]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 Apr 07 06:12:48 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:48 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26" returned: 0 in 0.573s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d43858d1-1a50-4eed-86a6-d784da7b0642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b23c0c2-25b6-4173-8032-2242357716fa]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 Apr 07 06:12:48 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642" returned: 0 in 0.683s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 Apr 07 06:12:49 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26" returned: 0 in 0.608s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26 Apr 07 06:12:49 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:50 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642.a8b49351-7bda-44a0-b2e2-05f215f90c26" returned: 0 in 0.502s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-a8b49351-7bda-44a0-b2e2-05f215f90c26" released by "_delete_snapshot" :: held 2.434s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" released by "delete_snapshot" :: held 2.450s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:50 devstack cinder-volume[83450]: WARNING cinder.quota [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-973404833 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-973404833, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:50 devstack cinder-volume[83450]: WARNING cinder.quota [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-973404833 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-973404833, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:50 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['0ba5477d-02e6-49ca-ac04-1f928c52a165', '967c4c84-5668-42a3-9ee2-ba846fea5026', '84ac240e-7667-4247-b0e5-8fc6bd9b4dd0', '2e786fc1-ef7d-496f-aed1-4a34b65cd8e3'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:50 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['e14632eb-eddc-4638-96ec-d48a0306c52a', '62a50c0d-61a2-4c9e-9000-817e4f99b1f3', 'fb750f76-663d-4e6f-aec8-fdab9937b8f2', '28347593-0e60-4db1-898f-92ed2b668693'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e0da8f1f-d2e8-4efd-b897-ad9019764a25 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 484d6206-6f32-4f24-a95f-030fa0af9e39: deleted successfully Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" acquired by "delete_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eac8c5-03f1-43ba-932e-5536bf3212a4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b Apr 07 06:12:51 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b" returned: 0 in 0.563s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b Apr 07 06:12:51 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1cc9edd0-f043-40df-894b-b65570d8b97b" returned: 0 in 0.492s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-1cc9edd0-f043-40df-894b-b65570d8b97b" released by "delete_volume" :: held 1.102s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1b3e1-1e64-436d-958e-2721613ce8c0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 Apr 07 06:12:52 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642" returned: 0 in 0.642s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642 Apr 07 06:12:52 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:53 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d43858d1-1a50-4eed-86a6-d784da7b0642" returned: 0 in 0.604s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-d43858d1-1a50-4eed-86a6-d784da7b0642" released by "delete_volume" :: held 1.311s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['c7cf2b05-0444-4a77-97de-113c8db44e1e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:53 devstack cinder-volume[83450]: WARNING cinder.quota [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-973404833 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-973404833, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['21580529-5769-4e3a-9fce-e3ce97b3e2f4', '6b1b83d6-6af5-45f1-9523-20b3ea9148bb', '30aaf71b-d0db-4036-af5b-40e29ea8936f', 'c9e620fa-a9f4-4c96-b208-726dbd86b62e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['7f6acd87-c0d9-4a1d-9939-1624c4821ce6', 'ce8bd2c9-dd59-43b5-bc6e-446b6fd84ba4', '9a9dd9ee-5b80-48bb-b056-cb6554ca68ba', 'd5f44fa5-696a-4d56-bc8b-332b357dd9ec'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:53 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:12:53 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:54 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.488s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ce32457d-8b0b-4918-951d-6b6d293b8134 tempest-GroupSnapshotsTest-911934378 None] Delete group completed successfully. Apr 07 06:12:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e2561b13-e4ef-4727-bb16-8084bae3075a tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-1498856208: creating Apr 07 06:12:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e2561b13-e4ef-4727-bb16-8084bae3075a tempest-GroupSnapshotsTest-911934378 None] Group tempest-GroupSnapshotsTest-Group-1498856208: created successfully Apr 07 06:12:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e2561b13-e4ef-4727-bb16-8084bae3075a tempest-GroupSnapshotsTest-911934378 None] Create group completed successfully. Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (df81c081-8469-4501-a3a8-267b8049e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4700f07e-9b65-453f-b25d-0764a94646e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4700f07e-9b65-453f-b25d-0764a94646e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644639959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17571c33-ec97-44a1-b3d9-0d07ae88a2d4,host='devstack@QuobyteHD#QuobyteHD',id=af10982c-8a1e-48a1-9deb-edd1fcf0ca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:56Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e7b757c-0e3d-4865-8071-a94badc34c85),volume_type_id=4e7b757c-0e3d-4865-8071-a94badc34c85)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c3817f-f08a-44a0-a75c-c658d096d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c3817f-f08a-44a0-a75c-c658d096d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32891b6-5d88-4e98-a896-825aed0a8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32891b6-5d88-4e98-a896-825aed0a8044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af10982c-8a1e-48a1-9deb-edd1fcf0ca06', 'volume_name': 'volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3abd66e-2e54-46be-9c7b-563b8ca27f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3abd66e-2e54-46be-9c7b-563b8ca27f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad22f1b9-5bfd-4af9-a7c0-54a182c49a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Volume af10982c-8a1e-48a1-9deb-edd1fcf0ca06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06', 'volume_size': 1} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17571c33-ec97-44a1-b3d9-0d07ae88a2d4,created_at=2026-04-07T04:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644639959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17571c33-ec97-44a1-b3d9-0d07ae88a2d4,host='devstack@QuobyteHD#QuobyteHD',id=af10982c-8a1e-48a1-9deb-edd1fcf0ca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e7f232b8eb4da3b1424f97541fb0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:56Z,use_quota=True,user_id='0217cfa418e34a73a1c175b5f8bf77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e7b757c-0e3d-4865-8071-a94badc34c85),volume_type_id=4e7b757c-0e3d-4865-8071-a94badc34c85)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Creating volume af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:56 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:12:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 1073741824 Apr 07 06:12:56 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 1073741824" returned: 0 in 0.598s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:57 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 Apr 07 06:12:57 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" returned: 0 in 0.453s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad22f1b9-5bfd-4af9-a7c0-54a182c49a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51374fb0-47aa-404d-843f-b137e6cc878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:57 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Volume volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 (af10982c-8a1e-48a1-9deb-edd1fcf0ca06): created successfully Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51374fb0-47aa-404d-843f-b137e6cc878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Flow 'volume_create_manager' (df81c081-8469-4501-a3a8-267b8049e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-075b70ab-2244-4909-8484-5b3d34c54a16 tempest-GroupSnapshotsTest-911934378 None] Created volume successfully. Apr 07 06:12:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] GroupSnapshot 735077d1-de96-4872-9662-83b75f7f543f: creating. Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Group snapshot 735077d1-de96-4872-9662-83b75f7f543f: creating. {{(pid=83450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Creating offline snapshot c71ce529-1c9c-46b5-b356-14184d38947b of volume af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f9f9d-7830-42f5-9aec-206b323992d2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:58 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 Apr 07 06:12:58 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:59 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" returned: 0 in 0.749s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:59 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b 1G Apr 07 06:12:59 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:00 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b 1G" returned: 0 in 0.733s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:00 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b Apr 07 06:13:00 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:00 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b" returned: 0 in 0.549s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:00 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:13:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:00 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b Apr 07 06:13:00 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d1b4a4fc-09ae-4899-81ff-3fd91e2dc23e tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" by "attach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d1b4a4fc-09ae-4899-81ff-3fd91e2dc23e tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" acquired by "attach_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d1b4a4fc-09ae-4899-81ff-3fd91e2dc23e tempest-VolumesActionsTest-41510837 None] Attaching volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 to instance 083d3981-b508-4a0e-ad32-e63c82dfa476 at mountpoint /dev/vdb on host None. Apr 07 06:13:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d1b4a4fc-09ae-4899-81ff-3fd91e2dc23e tempest-VolumesActionsTest-41510837 None] Attach volume completed successfully. Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d1b4a4fc-09ae-4899-81ff-3fd91e2dc23e tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" released by "attach_volume" :: held 0.086s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:01 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b" returned: 0 in 0.535s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:01 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info Apr 07 06:13:01 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d2b7865d-a8e0-4ede-bf46-80c94cbdefd1 tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" by "detach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d2b7865d-a8e0-4ede-bf46-80c94cbdefd1 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d2b7865d-a8e0-4ede-bf46-80c94cbdefd1 tempest-VolumesActionsTest-41510837 None] Detaching volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 from instance 083d3981-b508-4a0e-ad32-e63c82dfa476. Apr 07 06:13:01 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info" returned: 0 in 0.481s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:01 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:01 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info Apr 07 06:13:01 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d2b7865d-a8e0-4ede-bf46-80c94cbdefd1 tempest-VolumesActionsTest-41510837 None] Detach volume completed successfully. Apr 07 06:13:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d2b7865d-a8e0-4ede-bf46-80c94cbdefd1 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:02 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.info" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.567s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1c1b61cf-ad20-4b14-8187-8894223d81fa tempest-GroupSnapshotsTest-911934378 None] group_snapshot 735077d1-de96-4872-9662-83b75f7f543f: created successfully Apr 07 06:13:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 735077d1-de96-4872-9662-83b75f7f543f: deleting Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 735077d1-de96-4872-9662-83b75f7f543f: deleting {{(pid=83450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-c71ce529-1c9c-46b5-b356-14184d38947b" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-c71ce529-1c9c-46b5-b356-14184d38947b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Deleting offline snapshot c71ce529-1c9c-46b5-b356-14184d38947b of volume af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] snapshot_file for this snap is: volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c168c27-da62-4508-8f38-18eb18ce0961]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:03 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b Apr 07 06:13:03 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:03 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b" returned: 0 in 0.788s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[16484508-5b89-426d-8aef-af914c6a4e88]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:04 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 Apr 07 06:13:04 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:04 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" returned: 0 in 0.586s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:04 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b Apr 07 06:13:04 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:05 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b" returned: 0 in 0.599s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:05 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b Apr 07 06:13:05 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:05 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06.c71ce529-1c9c-46b5-b356-14184d38947b" returned: 0 in 0.526s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-c71ce529-1c9c-46b5-b356-14184d38947b" released by "_delete_snapshot" :: held 2.593s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" released by "delete_snapshot" :: held 2.610s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:05 devstack cinder-volume[83450]: WARNING cinder.quota [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-805076158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-805076158, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:13:05 devstack cinder-volume[83450]: WARNING cinder.quota [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-805076158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-805076158, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:13:05 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['84eef119-60ea-4e14-a9d6-fd120d3bb2a8', '9723191f-f076-4f9e-a722-46de583ff609', 'b3d0b07c-0ef9-429a-80d0-fb914b1a3d00', 'b39f0a68-9552-4d5d-bb97-50de5f1fe564'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:05 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-665c0350-d92f-453b-824c-ec95bcdb9f58 tempest-GroupSnapshotsTest-911934378 None] group_snapshot 735077d1-de96-4872-9662-83b75f7f543f: deleted successfully Apr 07 06:13:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:06 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a7fdb-f116-48ab-9bc7-a3819bcb1855]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:06 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 Apr 07 06:13:06 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:07 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" returned: 0 in 0.602s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:07 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06 Apr 07 06:13:07 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:07 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" returned: 0 in 0.536s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Lock "cinder-quobyte-af10982c-8a1e-48a1-9deb-edd1fcf0ca06" released by "delete_volume" :: held 1.181s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['e86fb7e2-f801-4b09-a87b-b30394e33edc'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:07 devstack cinder-volume[83450]: WARNING cinder.quota [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-805076158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-805076158, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Created reservations ['0981e9ca-844d-4096-8cd1-1fdb7fb40c75', '9c11b456-6acd-41d5-ada6-bb14b9b84c5b', '98394712-1185-4163-9f62-f73fab0c69a1', '90eeaa28-87eb-4fc6-9487-19f92d59ebf0'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:08 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:08 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:08 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.493s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:08 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:08 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0462bccb-92f7-484a-9b22-3479c3c19673 tempest-GroupSnapshotsTest-911934378 None] Delete group completed successfully. Apr 07 06:13:17 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=63,cinder:UPDATE=67,cinder:DELETE=2,cinder:INSERT=17 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:17 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=63,cinder:UPDATE=58,cinder:INSERT=14 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Flow 'volume_create_manager' (76719f77-7492-451e-a18d-67d0a4bd9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d5d6c4-57a9-4c28-b95b-c887a73b67f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d5d6c4-57a9-4c28-b95b-c887a73b67f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-501285768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef243dff-8026-405b-841a-5164224f6b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09144ba0be46a28e9e689869fd8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:19Z,use_quota=True,user_id='92ec50bca2e34cb6a7f4db5210c62efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd6c52-bf62-4fe5-b2a4-be93f6650f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd6c52-bf62-4fe5-b2a4-be93f6650f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf4340b-4c87-4a87-b42d-b50872eb1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf4340b-4c87-4a87-b42d-b50872eb1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef243dff-8026-405b-841a-5164224f6b51', 'volume_name': 'volume-ef243dff-8026-405b-841a-5164224f6b51', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeeb87a-6bf0-429e-9b2b-5194ef336bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeeb87a-6bf0-429e-9b2b-5194ef336bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec85af48-da29-4407-b805-f2c992dc0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:18 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume ef243dff-8026-405b-841a-5164224f6b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef243dff-8026-405b-841a-5164224f6b51', 'volume_size': 1} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-501285768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef243dff-8026-405b-841a-5164224f6b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09144ba0be46a28e9e689869fd8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:19Z,use_quota=True,user_id='92ec50bca2e34cb6a7f4db5210c62efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Creating volume ef243dff-8026-405b-841a-5164224f6b51 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:18 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:13:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:18 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 1073741824 Apr 07 06:13:18 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:19 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 1073741824" returned: 0 in 0.621s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:19 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 Apr 07 06:13:19 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:20 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51" returned: 0 in 0.591s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec85af48-da29-4407-b805-f2c992dc0052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef243dff-8026-405b-841a-5164224f6b51', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37440de-934e-4d0e-a905-4ba150ca06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:20 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume volume-ef243dff-8026-405b-841a-5164224f6b51 (ef243dff-8026-405b-841a-5164224f6b51): created successfully Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37440de-934e-4d0e-a905-4ba150ca06df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Flow 'volume_create_manager' (76719f77-7492-451e-a18d-67d0a4bd9f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-187f54d8-65c2-462b-b314-179a7aec5b0e tempest-VolumeQuotasAdminTestJSON-124734288 None] Created volume successfully. Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "cinder-ef243dff-8026-405b-841a-5164224f6b51-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "cinder-ef243dff-8026-405b-841a-5164224f6b51-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "cinder-quobyte-ef243dff-8026-405b-841a-5164224f6b51" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "cinder-quobyte-ef243dff-8026-405b-841a-5164224f6b51" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:21 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516bf39-3b28-4eff-bd91-eff289ecb034]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 Apr 07 06:13:21 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51" returned: 0 in 0.550s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51 Apr 07 06:13:21 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:22 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ef243dff-8026-405b-841a-5164224f6b51" returned: 0 in 0.709s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "cinder-quobyte-ef243dff-8026-405b-841a-5164224f6b51" released by "delete_volume" :: held 1.306s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Created reservations ['c97e7be1-e26f-449b-b025-fd9fe564703d', 'cd272081-bafb-4552-87ff-c40878e8322b', '6866a227-4911-4f5e-a20b-4bbab2b46a1d', 'dd22c053-afc4-4dab-b3fa-239d071ed8d4'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:22 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:22 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:22 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.575s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Deleted volume successfully. Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-295dc927-051a-4539-8f9e-0a5976a004ef tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "cinder-ef243dff-8026-405b-841a-5164224f6b51-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Flow 'volume_create_manager' (99214398-d9c4-45a7-854d-5213fda940bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc89628a-3fa9-4241-9194-34b73a7162f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc89628a-3fa9-4241-9194-34b73a7162f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106397235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287d6eba-a384-4ab7-86b9-a62989ad6331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09144ba0be46a28e9e689869fd8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:23Z,use_quota=True,user_id='92ec50bca2e34cb6a7f4db5210c62efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d084ba-694f-4fd2-87d4-c4ba2b5cda59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d084ba-694f-4fd2-87d4-c4ba2b5cda59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9c534-4dea-4fe7-bbfa-6ddb979d920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9c534-4dea-4fe7-bbfa-6ddb979d920b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287d6eba-a384-4ab7-86b9-a62989ad6331', 'volume_name': 'volume-287d6eba-a384-4ab7-86b9-a62989ad6331', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b2489f-1c3f-4b70-b734-011b4dc4c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b2489f-1c3f-4b70-b734-011b4dc4c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32d876f-3a35-44fe-9c53-2180031191ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume 287d6eba-a384-4ab7-86b9-a62989ad6331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287d6eba-a384-4ab7-86b9-a62989ad6331', 'volume_size': 1} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106397235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287d6eba-a384-4ab7-86b9-a62989ad6331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09144ba0be46a28e9e689869fd8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:23Z,use_quota=True,user_id='92ec50bca2e34cb6a7f4db5210c62efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Creating volume 287d6eba-a384-4ab7-86b9-a62989ad6331 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:23 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:13:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:23 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 1073741824 Apr 07 06:13:23 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:24 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 1073741824" returned: 0 in 0.534s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:24 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 Apr 07 06:13:24 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c93505c9-b5ed-452e-b8aa-298d5ebb0f89 tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" by "attach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c93505c9-b5ed-452e-b8aa-298d5ebb0f89 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" acquired by "attach_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c93505c9-b5ed-452e-b8aa-298d5ebb0f89 tempest-VolumesActionsTest-41510837 None] Attaching volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 to instance 0ffa83e8-73ac-4835-bf3b-d56b461925f0 at mountpoint /dev/vdb on host None. Apr 07 06:13:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c93505c9-b5ed-452e-b8aa-298d5ebb0f89 tempest-VolumesActionsTest-41510837 None] Attach volume completed successfully. Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c93505c9-b5ed-452e-b8aa-298d5ebb0f89 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" released by "attach_volume" :: held 0.072s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:24 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331" returned: 0 in 0.530s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32d876f-3a35-44fe-9c53-2180031191ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287d6eba-a384-4ab7-86b9-a62989ad6331', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdbe05-f8ae-4c78-b78b-38a8cbec5b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Volume volume-287d6eba-a384-4ab7-86b9-a62989ad6331 (287d6eba-a384-4ab7-86b9-a62989ad6331): created successfully Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdbe05-f8ae-4c78-b78b-38a8cbec5b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Flow 'volume_create_manager' (99214398-d9c4-45a7-854d-5213fda940bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e98d363f-3bd6-4373-8097-4a4549bcfadc tempest-VolumeQuotasAdminTestJSON-124734288 None] Created volume successfully. Apr 07 06:13:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-606f7e2e-4f50-4bff-afdb-a758c2ac0607 tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" by "detach_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-606f7e2e-4f50-4bff-afdb-a758c2ac0607 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-606f7e2e-4f50-4bff-afdb-a758c2ac0607 tempest-VolumesActionsTest-41510837 None] Detaching volume 5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 from instance 0ffa83e8-73ac-4835-bf3b-d56b461925f0. Apr 07 06:13:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-606f7e2e-4f50-4bff-afdb-a758c2ac0607 tempest-VolumesActionsTest-41510837 None] Detach volume completed successfully. Apr 07 06:13:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-606f7e2e-4f50-4bff-afdb-a758c2ac0607 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-411796af-e0ad-4709-84e3-ce6be29f5dad tempest-VolumeQuotasAdminTestJSON-642936425 None] Transfer volume completed successfully. Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Acquiring lock "cinder-287d6eba-a384-4ab7-86b9-a62989ad6331-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "cinder-287d6eba-a384-4ab7-86b9-a62989ad6331-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Acquiring lock "cinder-quobyte-287d6eba-a384-4ab7-86b9-a62989ad6331" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "cinder-quobyte-287d6eba-a384-4ab7-86b9-a62989ad6331" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e887a5c8-702e-42f3-83eb-376f5bde14c3]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:27 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 Apr 07 06:13:27 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:27 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331" returned: 0 in 0.552s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:27 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331 Apr 07 06:13:27 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-287d6eba-a384-4ab7-86b9-a62989ad6331" returned: 0 in 0.553s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "cinder-quobyte-287d6eba-a384-4ab7-86b9-a62989ad6331" released by "delete_volume" :: held 1.130s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Created reservations ['cc07613f-cb9b-444c-887e-728445893945', '08f85c85-dbc4-43e5-93e1-e49b6f404271', '402f97a3-3aad-4734-abf6-c26b7fcfa9eb', 'ba10e006-ca77-4183-96f6-8d50e24f0709'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:28 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:28 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.475s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:28 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Deleted volume successfully. Apr 07 06:13:28 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0e19ea1-fd9e-492a-9515-a58ca66867f9 tempest-VolumeQuotasAdminTestJSON-161217637 None] Lock "cinder-287d6eba-a384-4ab7-86b9-a62989ad6331-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[117c1c05-713e-4054-8920-5fc1916f4cd0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:34 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:34 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Flow 'volume_create_manager' (0bbfb5ba-3df5-4d6e-8e7e-bb51731b4dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a557b7-d237-4fa7-a6d1-692d2c6325c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a557b7-d237-4fa7-a6d1-692d2c6325c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-862228581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53431931-acde-45d8-9176-db0d5c6a82b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f3e08da8e941ae8dbd20fcccdfb811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:35Z,use_quota=True,user_id='cdb1dd23adb84bc1a9316842fc429749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23668da2-ae64-4099-8bcb-d5b9b25e00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23668da2-ae64-4099-8bcb-d5b9b25e00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10073d9-7989-4a5b-b3ff-dee4c086ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10073d9-7989-4a5b-b3ff-dee4c086ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53431931-acde-45d8-9176-db0d5c6a82b5', 'volume_name': 'volume-53431931-acde-45d8-9176-db0d5c6a82b5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afb115-e34a-451e-a77b-b2180f73d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afb115-e34a-451e-a77b-b2180f73d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87af99f8-cc94-41c2-8bc6-b74b5ec24725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Volume 53431931-acde-45d8-9176-db0d5c6a82b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53431931-acde-45d8-9176-db0d5c6a82b5', 'volume_size': 1} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:34 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.529s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb4be1-fbbb-445d-8545-a38f2e79051e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:35 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:35 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.527s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.295c87c0-3576-477b-abdf-568ec79409f7iit3rqko.img {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.295c87c0-3576-477b-abdf-568ec79409f7iit3rqko.img Apr 07 06:13:35 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:37 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.295c87c0-3576-477b-abdf-568ec79409f7iit3rqko.img" returned: 0 in 2.217s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[79869fc4-8cbb-4002-b5aa-d536e0dc38d7]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:37 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:37 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:38 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.629s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:38 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.295c87c0-3576-477b-abdf-568ec79409f7iit3rqko.img {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:38 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Converted 1024.00 MB image at 461.62 MB/s Apr 07 06:13:38 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] 295c87c0-3576-477b-abdf-568ec79409f7 was raw, no need to convert to raw {{(pid=83450) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:46 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:46 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:46 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.519s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=3,cinder:DELETE=2 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.031s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Uploaded volume to glance image-id: 295c87c0-3576-477b-abdf-568ec79409f7. {{(pid=83450) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=18,cinder:UPDATE=21,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.666s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-862228581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53431931-acde-45d8-9176-db0d5c6a82b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f3e08da8e941ae8dbd20fcccdfb811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:35Z,use_quota=True,user_id='cdb1dd23adb84bc1a9316842fc429749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Creating volume 53431931-acde-45d8-9176-db0d5c6a82b5 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:48 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:13:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:48 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 1073741824 Apr 07 06:13:48 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-27f06080-6bca-47f2-bc50-2e21b3f3d514 tempest-VolumesActionsTest-41510837 None] Copy volume to image completed successfully. Apr 07 06:13:49 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 1073741824" returned: 0 in 0.575s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:49 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 Apr 07 06:13:49 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:49 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87af99f8-cc94-41c2-8bc6-b74b5ec24725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53431931-acde-45d8-9176-db0d5c6a82b5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8925dd-ffc2-4e47-ae93-3871dc90e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Volume volume-53431931-acde-45d8-9176-db0d5c6a82b5 (53431931-acde-45d8-9176-db0d5c6a82b5): created successfully Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8925dd-ffc2-4e47-ae93-3871dc90e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Flow 'volume_create_manager' (0bbfb5ba-3df5-4d6e-8e7e-bb51731b4dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7fef4e90-cd6a-4294-846c-959be04ca0dc tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Created volume successfully. Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc94648-a07b-4223-9f2b-182e3d0ccaf7]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:49 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:49 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:50 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.508s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d174b04-ee8b-4f54-8536-a0e4bc553801]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:50 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:50 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:50 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.510s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:50 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img Apr 07 06:13:50 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Acquiring lock "cinder-53431931-acde-45d8-9176-db0d5c6a82b5-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "cinder-53431931-acde-45d8-9176-db0d5c6a82b5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Acquiring lock "cinder-quobyte-53431931-acde-45d8-9176-db0d5c6a82b5" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "cinder-quobyte-53431931-acde-45d8-9176-db0d5c6a82b5" acquired by "delete_volume" :: waited 0.025s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fffab0b-299e-43bb-9a9b-bc2ae92d1732]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:52 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 Apr 07 06:13:52 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img" returned: 0 in 2.362s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5" returned: 0 in 1.024s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1de4139-e403-44dc-918c-7c0a6ce5d5ec]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5 Apr 07 06:13:53 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:53 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-53431931-acde-45d8-9176-db0d5c6a82b5" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "cinder-quobyte-53431931-acde-45d8-9176-db0d5c6a82b5" released by "delete_volume" :: held 1.552s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:53 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.681s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:53 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Converted 1024.00 MB image at 433.35 MB/s Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] a833a13b-6d2f-46c3-9ea0-4257489eff40 was raw, converting to qcow2 {{(pid=83450) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2968b92-05e1-42a2-8ae9-67c313c0c2d0]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img Apr 07 06:13:53 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img" returned: 0 in 0.467s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img Apr 07 06:13:54 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Created reservations ['706c0c0a-0802-4f1b-b02e-8500b8bad521', '20e79887-ebca-4f62-a1b9-67d172d596ce', 'ce4757b0-dd16-4ddb-8eb6-3b830eb380f4', '640e391b-f2d7-48fe-931c-575703bbca82'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:54 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img" returned: 1 in 0.510s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8 Apr 07 06:13:54 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.450s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Deleted volume successfully. Apr 07 06:13:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5a7cbecd-4f87-45f9-9eff-971d34b00feb tempest-VolumeQuotasNegativeTestJSON-1688709450 None] Lock "cinder-53431931-acde-45d8-9176-db0d5c6a82b5-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:55 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8" returned: 0 in 0.443s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:55 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Image conversion details: src /opt/stack/data/cinder/conversion/5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2.temp_image.a833a13b-6d2f-46c3-9ea0-4257489eff40kn6ojn18.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:55 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 07 06:13:55 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe88c24-cb6b-433f-aeec-a532f8f61472]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:55 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8 Apr 07 06:13:55 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:55 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkggrkz8" returned: 0 in 0.536s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.665s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:57 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Uploaded volume to glance image-id: a833a13b-6d2f-46c3-9ea0-4257489eff40. {{(pid=83450) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 07 06:13:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ba1ca410-5a63-49df-82a8-a6848cebebad tempest-VolumesActionsTest-41510837 None] Copy volume to image completed successfully. Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Acquiring lock "cinder-quobyte-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "cinder-quobyte-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa6211-a415-4edc-b8eb-3718448fdc77]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:58 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:58 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:59 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.598s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:59 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2 Apr 07 06:13:59 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Flow 'volume_create_manager' (29ecab03-0ce3-4e25-bf05-1ab3c555ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd1fc23-4ed9-4cc3-94a6-d962da66a268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd1fc23-4ed9-4cc3-94a6-d962da66a268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-206283775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f9b09a-01f0-4f8d-9908-52b266873432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f80a3b278f4b948a59113739068340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:59Z,use_quota=True,user_id='594b19f4bd3449d7ba8ed3be680076ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5438bf2d-3564-4118-95f3-7c6f251a8317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5438bf2d-3564-4118-95f3-7c6f251a8317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb97fa3-5481-4137-862e-32dfb17fa192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb97fa3-5481-4137-862e-32dfb17fa192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f9b09a-01f0-4f8d-9908-52b266873432', 'volume_name': 'volume-02f9b09a-01f0-4f8d-9908-52b266873432', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03717769-7085-47e8-b94c-e4a82b77f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03717769-7085-47e8-b94c-e4a82b77f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f744d272-cdf4-46ca-9020-6ca1f7a27b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Volume 02f9b09a-01f0-4f8d-9908-52b266873432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f9b09a-01f0-4f8d-9908-52b266873432', 'volume_size': 1} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-206283775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f9b09a-01f0-4f8d-9908-52b266873432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f80a3b278f4b948a59113739068340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:59Z,use_quota=True,user_id='594b19f4bd3449d7ba8ed3be680076ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Creating volume 02f9b09a-01f0-4f8d-9908-52b266873432 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:59 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:59 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 1073741824 Apr 07 06:13:59 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:59 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" returned: 0 in 0.523s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "cinder-quobyte-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2" released by "delete_volume" :: held 1.152s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Created reservations ['e0df68ac-88e9-4831-bc45-66c9c6988e66', 'dcb262f6-e921-46e3-b6ed-fdd792f5ebdc', '3094bcf7-2354-433c-9350-2ca294cfada2', '30ef8015-fa19-4c1e-819e-6ad15a887063'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:59 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:13:59 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:00 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 1073741824" returned: 0 in 0.617s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:00 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 Apr 07 06:14:00 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:00 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.510s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Deleted volume successfully. Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bd63339c-0e05-4973-ac54-91c869b1ca28 tempest-VolumesActionsTest-41510837 None] Lock "cinder-5b3cb5f6-aa31-4efe-b9ac-8baf7e6f1ce2-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:00 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432" returned: 0 in 0.467s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f744d272-cdf4-46ca-9020-6ca1f7a27b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f9b09a-01f0-4f8d-9908-52b266873432', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431dc85a-3cca-4fbf-88ec-58e8beda18d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Volume volume-02f9b09a-01f0-4f8d-9908-52b266873432 (02f9b09a-01f0-4f8d-9908-52b266873432): created successfully Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431dc85a-3cca-4fbf-88ec-58e8beda18d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Flow 'volume_create_manager' (29ecab03-0ce3-4e25-bf05-1ab3c555ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-de129295-8139-4df9-b462-4b40ce3844e1 tempest-VolumesServicesTestJSON-1824988461 None] Created volume successfully. Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Acquiring lock "cinder-02f9b09a-01f0-4f8d-9908-52b266873432-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "cinder-02f9b09a-01f0-4f8d-9908-52b266873432-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Acquiring lock "cinder-quobyte-02f9b09a-01f0-4f8d-9908-52b266873432" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "cinder-quobyte-02f9b09a-01f0-4f8d-9908-52b266873432" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7103a83-4675-43d3-90a5-3c7ec55120ff]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:01 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 Apr 07 06:14:01 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:02 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432" returned: 0 in 0.507s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:02 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432 Apr 07 06:14:02 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:02 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-02f9b09a-01f0-4f8d-9908-52b266873432" returned: 0 in 0.464s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "cinder-quobyte-02f9b09a-01f0-4f8d-9908-52b266873432" released by "delete_volume" :: held 1.000s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Created reservations ['87135f38-3c71-4a49-a29b-04acda9f4627', 'd0df8247-b447-4a18-9840-25e68fe077e2', '97f6a010-ef07-4e29-bb1a-670f7893f9ef', '731ac6fb-0edb-4dbb-ae9d-3025fc469b4a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:02 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:02 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:03 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:03 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Deleted volume successfully. Apr 07 06:14:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b8d96bf3-47b9-45e8-9423-3f06ac83cd8c tempest-VolumesServicesTestJSON-1824988461 None] Lock "cinder-02f9b09a-01f0-4f8d-9908-52b266873432-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Flow 'volume_create_manager' (0fadda8e-bc0a-4315-a826-efed257c3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b95387-8809-4003-b44d-a7360f41da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b95387-8809-4003-b44d-a7360f41da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1792276573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85ddbdd-5960-4315-9013-9ad3e67d4541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49b4c09943143ef9924cca6861804cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:12Z,use_quota=True,user_id='c515989e364c4c14840c6fa0a1b91b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1d575bc-d808-49be-9990-e5bb8b64fbd2),volume_type_id=b1d575bc-d808-49be-9990-e5bb8b64fbd2)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74e3824-c018-40ac-a989-b9a13bbb2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74e3824-c018-40ac-a989-b9a13bbb2918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50240ecd-169f-4a11-b4c3-1abe5f3bc4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50240ecd-169f-4a11-b4c3-1abe5f3bc4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85ddbdd-5960-4315-9013-9ad3e67d4541', 'volume_name': 'volume-d85ddbdd-5960-4315-9013-9ad3e67d4541', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed489ce-adfd-43e7-9e52-3ffb4a3588ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed489ce-adfd-43e7-9e52-3ffb4a3588ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca30b16-fd66-473f-864a-2e2f93c9b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Volume d85ddbdd-5960-4315-9013-9ad3e67d4541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85ddbdd-5960-4315-9013-9ad3e67d4541', 'volume_size': 1} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1792276573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85ddbdd-5960-4315-9013-9ad3e67d4541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49b4c09943143ef9924cca6861804cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:12Z,use_quota=True,user_id='c515989e364c4c14840c6fa0a1b91b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1d575bc-d808-49be-9990-e5bb8b64fbd2),volume_type_id=b1d575bc-d808-49be-9990-e5bb8b64fbd2)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Creating volume d85ddbdd-5960-4315-9013-9ad3e67d4541 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:12 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:12 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 1073741824 Apr 07 06:14:12 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:12 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 1073741824" returned: 0 in 0.560s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:12 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 Apr 07 06:14:12 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:13 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541" returned: 0 in 0.537s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca30b16-fd66-473f-864a-2e2f93c9b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85ddbdd-5960-4315-9013-9ad3e67d4541', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b12ba0-569f-4984-bcfd-d9465f134bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:13 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Volume volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 (d85ddbdd-5960-4315-9013-9ad3e67d4541): created successfully Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b12ba0-569f-4984-bcfd-d9465f134bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Flow 'volume_create_manager' (0fadda8e-bc0a-4315-a826-efed257c3956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:13 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7e6661e6-43da-4962-ac11-4a53888419c7 tempest-VolumeTypesAccessTest-700600899 None] Created volume successfully. Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (13014df4-e302-47e1-9361-3b31f5cb1005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f482d50-8050-47da-82b6-6e57b6e13a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f482d50-8050-47da-82b6-6e57b6e13a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-423154854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c91f57-acc4-43a1-a636-93dd24391275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:14Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfda659f-97a7-48e3-ac6d-eeef627c3186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfda659f-97a7-48e3-ac6d-eeef627c3186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15afa339-6be7-4a80-be46-a0984d2db143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15afa339-6be7-4a80-be46-a0984d2db143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c91f57-acc4-43a1-a636-93dd24391275', 'volume_name': 'volume-e6c91f57-acc4-43a1-a636-93dd24391275', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578b445b-95f4-4f64-b28f-5e47b7a7a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578b445b-95f4-4f64-b28f-5e47b7a7a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d126ee-2ae1-4d96-81b0-0744280f9aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:14 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Volume e6c91f57-acc4-43a1-a636-93dd24391275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c91f57-acc4-43a1-a636-93dd24391275', 'volume_size': 1} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-423154854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c91f57-acc4-43a1-a636-93dd24391275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:14Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Creating volume e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 1073741824 Apr 07 06:14:14 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Acquiring lock "cinder-d85ddbdd-5960-4315-9013-9ad3e67d4541-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "cinder-d85ddbdd-5960-4315-9013-9ad3e67d4541-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Acquiring lock "cinder-quobyte-d85ddbdd-5960-4315-9013-9ad3e67d4541" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "cinder-quobyte-d85ddbdd-5960-4315-9013-9ad3e67d4541" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d7968-803b-42f6-92cc-e116fb89f6db]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 Apr 07 06:14:14 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 1073741824" returned: 0 in 0.547s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 Apr 07 06:14:14 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541" returned: 0 in 0.533s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541 Apr 07 06:14:14 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275" returned: 0 in 0.484s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d126ee-2ae1-4d96-81b0-0744280f9aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c91f57-acc4-43a1-a636-93dd24391275', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3957dc3-a3a6-4145-9fa9-489c2083b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:15 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Volume volume-e6c91f57-acc4-43a1-a636-93dd24391275 (e6c91f57-acc4-43a1-a636-93dd24391275): created successfully Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3957dc3-a3a6-4145-9fa9-489c2083b42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (13014df4-e302-47e1-9361-3b31f5cb1005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c5fabb78-146d-4437-b400-9908423dc1ff tempest-VolumesSnapshotTestJSON-1113340565 None] Created volume successfully. Apr 07 06:14:15 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-d85ddbdd-5960-4315-9013-9ad3e67d4541" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "cinder-quobyte-d85ddbdd-5960-4315-9013-9ad3e67d4541" released by "delete_volume" :: held 1.052s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:15 devstack cinder-volume[83450]: WARNING cinder.quota [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1345238684 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1345238684, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:14:15 devstack cinder-volume[83450]: WARNING cinder.quota [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1345238684 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1345238684, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Created reservations ['51f808d2-8f50-472a-8ae4-0515b5d08a56', '9a5f2ed8-d3a6-44e4-b1ec-2413b842c9f9', 'a2b42438-fad0-4ca0-b649-08549d784ca8', '3abd226f-a050-4560-8a09-d4f23de7b7e6'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:15 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:15 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.436s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Deleted volume successfully. Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e036183b-a5b1-454c-8ed3-4a7dad974228 tempest-VolumeTypesAccessTest-700600899 None] Lock "cinder-d85ddbdd-5960-4315-9013-9ad3e67d4541-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Creating offline snapshot cae5187c-ff92-4edb-9817-73983e178074 of volume e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacaaa01-df37-4e83-a160-9fa754e03fba]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:16 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 Apr 07 06:14:16 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:17 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275" returned: 0 in 0.585s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:17 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 1G Apr 07 06:14:17 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:17 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 1G" returned: 0 in 0.578s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c91f57-acc4-43a1-a636-93dd24391275 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:17 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c91f57-acc4-43a1-a636-93dd24391275 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 Apr 07 06:14:17 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:18 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c91f57-acc4-43a1-a636-93dd24391275 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074" returned: 0 in 0.594s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:18 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 is being set with open permissions: ugo+rw Apr 07 06:14:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:18 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 Apr 07 06:14:18 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:18 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074" returned: 0 in 0.505s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:18 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info Apr 07 06:14:18 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:19 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info" returned: 0 in 0.475s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:19 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info is being set with open permissions: ugo+rw Apr 07 06:14:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:19 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info Apr 07 06:14:19 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:19 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.info" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:19 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3cf7bae8-e851-41be-b2ed-1f796f55047f tempest-VolumesSnapshotTestJSON-1113340565 None] Create snapshot completed successfully Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (e6052062-2492-4246-bd8f-a21d60017f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b2210-98a9-4329-aac9-acb56aaf6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b2210-98a9-4329-aac9-acb56aaf6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1936380222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c33d01e-884e-4744-bfea-75df463c019f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b4c6dd997a4d3985d6cda621f2f169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:21Z,use_quota=True,user_id='38f20b5329a74ee0a3a3aa55dce6e686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fd415c-eb52-4c2d-afcb-b7a2295f1a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fd415c-eb52-4c2d-afcb-b7a2295f1a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c1ce0f-c5ea-49df-a807-0a2a7bc71aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c1ce0f-c5ea-49df-a807-0a2a7bc71aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c33d01e-884e-4744-bfea-75df463c019f', 'volume_name': 'volume-1c33d01e-884e-4744-bfea-75df463c019f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec7aab-0694-42c1-98a5-ddc8a602f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec7aab-0694-42c1-98a5-ddc8a602f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75689fee-c7c8-41de-82ad-6f6e3a0f0ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:20 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Volume 1c33d01e-884e-4744-bfea-75df463c019f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c33d01e-884e-4744-bfea-75df463c019f', 'volume_size': 1} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1936380222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c33d01e-884e-4744-bfea-75df463c019f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b4c6dd997a4d3985d6cda621f2f169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:21Z,use_quota=True,user_id='38f20b5329a74ee0a3a3aa55dce6e686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Creating volume 1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:20 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-cae5187c-ff92-4edb-9817-73983e178074-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:20 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f 1073741824 Apr 07 06:14:20 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-cae5187c-ff92-4edb-9817-73983e178074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-cae5187c-ff92-4edb-9817-73983e178074" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-cae5187c-ff92-4edb-9817-73983e178074" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Deleting offline snapshot cae5187c-ff92-4edb-9817-73983e178074 of volume e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] snapshot_file for this snap is: volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5756e6c3-09c3-4a85-abb3-bd537fec4109]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 Apr 07 06:14:21 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f 1073741824" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f Apr 07 06:14:21 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074" returned: 0 in 0.590s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c91f57-acc4-43a1-a636-93dd24391275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a242c690-e852-4730-992c-a16defa3b8b1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 Apr 07 06:14:21 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f" returned: 0 in 0.477s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75689fee-c7c8-41de-82ad-6f6e3a0f0ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c33d01e-884e-4744-bfea-75df463c019f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5578672-9c88-43a4-9778-9500f44e9f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Volume volume-1c33d01e-884e-4744-bfea-75df463c019f (1c33d01e-884e-4744-bfea-75df463c019f): created successfully Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5578672-9c88-43a4-9778-9500f44e9f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (e6052062-2492-4246-bd8f-a21d60017f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:21 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1f42ac17-83cc-46b1-b1e9-a48cf6693abf tempest-VolumesDeleteCascade-1775382060 None] Created volume successfully. Apr 07 06:14:22 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275" returned: 0 in 0.557s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:22 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 Apr 07 06:14:22 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:22 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074" returned: 0 in 0.481s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:22 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074 Apr 07 06:14:22 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:23 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275.cae5187c-ff92-4edb-9817-73983e178074" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Creating offline snapshot e7c660f0-48da-4b50-b047-e04da9791362 of volume 1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45eab1-106e-4019-9929-0a3a0e9d892f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-cae5187c-ff92-4edb-9817-73983e178074" released by "_delete_snapshot" :: held 2.204s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" released by "delete_snapshot" :: held 2.227s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['6d9dad6a-2706-4a46-b996-09ad2ab6bba3', '831c8178-8ffa-498c-b0aa-69cc2f280769', '5207fc38-342e-40d4-a694-c3753e6aed44', '530bf3f7-522d-466c-9a1e-c4c8ccf2e39c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:23 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f Apr 07 06:14:23 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Delete snapshot completed successfully. Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-15493924-1870-417d-851c-862db537e8ce tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-cae5187c-ff92-4edb-9817-73983e178074-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:23 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f" returned: 0 in 0.545s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:23 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 1G Apr 07 06:14:23 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:24 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 1G" returned: 0 in 0.587s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:24 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:24 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (957d95c6-9809-406a-bc95-1286f1a19ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d57bf-b98d-41ff-8c50-679cc1decfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d57bf-b98d-41ff-8c50-679cc1decfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1608763437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ba1960-a3fc-4263-b996-af72eade40c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:24Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80f6b0b-cf08-478b-922d-19a9fa0c83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80f6b0b-cf08-478b-922d-19a9fa0c83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682523da-1e54-47b1-9f07-8e13674cac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682523da-1e54-47b1-9f07-8e13674cac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ba1960-a3fc-4263-b996-af72eade40c2', 'volume_name': 'volume-59ba1960-a3fc-4263-b996-af72eade40c2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16239ef-f941-465b-b5d5-6779ccc94688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16239ef-f941-465b-b5d5-6779ccc94688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fbc785-bd4e-4602-990a-a698d70eb5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Volume 59ba1960-a3fc-4263-b996-af72eade40c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ba1960-a3fc-4263-b996-af72eade40c2', 'volume_size': 1} Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:24 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.481s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:24 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 is being set with open permissions: ugo+rw Apr 07 06:14:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:24 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:24 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:25 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:25 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info Apr 07 06:14:25 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:25 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info" returned: 0 in 0.484s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:25 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info is being set with open permissions: ugo+rw Apr 07 06:14:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:25 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info Apr 07 06:14:25 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:26 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.info" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1608763437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ba1960-a3fc-4263-b996-af72eade40c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:24Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Creating volume 59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:26 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:26 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 1073741824 Apr 07 06:14:26 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-320dc429-9bb9-4b37-aec1-41d3c40ec8f8 tempest-VolumesDeleteCascade-1775382060 None] Create snapshot completed successfully Apr 07 06:14:26 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 1073741824" returned: 0 in 0.553s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:26 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:26 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:27 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fbc785-bd4e-4602-990a-a698d70eb5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ba1960-a3fc-4263-b996-af72eade40c2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d78c113-ff93-43c8-b654-df5f990eec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:27 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Volume volume-59ba1960-a3fc-4263-b996-af72eade40c2 (59ba1960-a3fc-4263-b996-af72eade40c2): created successfully Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d78c113-ff93-43c8-b654-df5f990eec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (957d95c6-9809-406a-bc95-1286f1a19ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:27 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-de9cc5b5-5434-4c16-a63c-c274264f3c3a tempest-VolumesSnapshotTestJSON-1113340565 None] Created volume successfully. Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Creating offline snapshot e3eb782b-8db5-42ef-948e-a9a5d4684d8d of volume 1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37efde9-b076-46f5-8ef4-6e7c70940ce6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:27 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:27 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:27 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.528s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c33d01e-884e-4744-bfea-75df463c019f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:27 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d 1G Apr 07 06:14:27 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:28 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d 1G" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:28 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d Apr 07 06:14:28 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:28 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:28 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d is being set with open permissions: ugo+rw Apr 07 06:14:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:28 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d Apr 07 06:14:28 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:29 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d" returned: 0 in 0.428s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.639s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Creating offline snapshot c62e391a-0c52-4201-bafd-01072f0a2c9e of volume 59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-23f677ab-0821-4d8a-a7c5-e0474edab0ff tempest-VolumesDeleteCascade-1775382060 None] Create snapshot completed successfully Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[08072723-61a3-41d3-a654-d639685570e9]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:29 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:29 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-1c33d01e-884e-4744-bfea-75df463c019f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-1c33d01e-884e-4744-bfea-75df463c019f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Performing cascade delete. {{(pid=83450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-e3eb782b-8db5-42ef-948e-a9a5d4684d8d-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-e3eb782b-8db5-42ef-948e-a9a5d4684d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-e3eb782b-8db5-42ef-948e-a9a5d4684d8d" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-e3eb782b-8db5-42ef-948e-a9a5d4684d8d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Deleting offline snapshot e3eb782b-8db5-42ef-948e-a9a5d4684d8d of volume 1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] snapshot_file for this snap is: volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e133873-a35c-4357-b735-813559b3a6cb]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:29 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d Apr 07 06:14:29 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:29 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.533s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:29 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e 1G Apr 07 06:14:29 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:30 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d" returned: 0 in 0.516s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c33d01e-884e-4744-bfea-75df463c019f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ade957-9e03-46ef-87ba-c8c3431f1136]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:30 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:30 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:30 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e 1G" returned: 0 in 0.548s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ba1960-a3fc-4263-b996-af72eade40c2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:30 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ba1960-a3fc-4263-b996-af72eade40c2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:30 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:30 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.623s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c33d01e-884e-4744-bfea-75df463c019f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:30 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d Apr 07 06:14:30 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:30 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ba1960-a3fc-4263-b996-af72eade40c2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.537s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:30 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e is being set with open permissions: ugo+rw Apr 07 06:14:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:31 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:31 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:31 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d" returned: 0 in 0.558s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:31 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d Apr 07 06:14:31 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:31 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:31 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info Apr 07 06:14:31 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:31 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e3eb782b-8db5-42ef-948e-a9a5d4684d8d" returned: 0 in 0.454s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-e3eb782b-8db5-42ef-948e-a9a5d4684d8d" released by "_delete_snapshot" :: held 2.201s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" released by "delete_snapshot" :: held 2.214s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['ea90c174-9255-4a2f-ae46-34c4d3416c5c', 'dd31b84b-d6b0-46c8-a960-39894529016b', '5e3e6d96-a033-46e8-ba66-d103ed738e85', 'a09a3469-dd00-4cc3-81de-c737795cbb5e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:31 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info" returned: 0 in 0.417s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:31 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info is being set with open permissions: ugo+rw Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:31 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info Apr 07 06:14:31 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:31 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Delete snapshot completed successfully. Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-e3eb782b-8db5-42ef-948e-a9a5d4684d8d-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-e7c660f0-48da-4b50-b047-e04da9791362-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-e7c660f0-48da-4b50-b047-e04da9791362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-e7c660f0-48da-4b50-b047-e04da9791362" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-e7c660f0-48da-4b50-b047-e04da9791362" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Deleting offline snapshot e7c660f0-48da-4b50-b047-e04da9791362 of volume 1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] snapshot_file for this snap is: volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f5a399-a20e-41a9-ac56-0686e4422655]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:32 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:32 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:32 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.info" returned: 0 in 0.451s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.033s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:32 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7218b759-2bf3-4249-b3bc-a87c5276d44b tempest-VolumesSnapshotTestJSON-1113340565 None] Create snapshot completed successfully Apr 07 06:14:32 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.499s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c33d01e-884e-4744-bfea-75df463c019f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e4647-866c-4eaa-bf8d-83884997d382]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:32 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f Apr 07 06:14:32 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:33 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f" returned: 0 in 0.556s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:33 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:33 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (77d77af2-bb0e-4d8b-874f-325fccd54741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba37db9b-e6b0-471d-a480-f0ef021d8c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba37db9b-e6b0-471d-a480-f0ef021d8c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110781050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065f295-c515-4c2f-a278-19988f534d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c62e391a-0c52-4201-bafd-01072f0a2c9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:33Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e693d427-a20d-48be-ab17-cb56cd5c6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e693d427-a20d-48be-ab17-cb56cd5c6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c11086-6ea7-48df-b919-ad5840571cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c11086-6ea7-48df-b919-ad5840571cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e065f295-c515-4c2f-a278-19988f534d4b', 'volume_name': 'volume-e065f295-c515-4c2f-a278-19988f534d4b', 'volume_size': 2, 'snapshot_id': 'c62e391a-0c52-4201-bafd-01072f0a2c9e'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce89eeec-5d4a-4484-b9b1-b9271c970754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce89eeec-5d4a-4484-b9b1-b9271c970754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885d758f-d3aa-4027-afe8-8ad197ca5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:33 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume e065f295-c515-4c2f-a278-19988f534d4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e065f295-c515-4c2f-a278-19988f534d4b', 'volume_size': 2, 'snapshot_id': 'c62e391a-0c52-4201-bafd-01072f0a2c9e'} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e-e065f295-c515-4c2f-a278-19988f534d4b" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e-e065f295-c515-4c2f-a278-19988f534d4b" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating volume e065f295-c515-4c2f-a278-19988f534d4b from snapshot c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] snapshot: c62e391a-0c52-4201-bafd-01072f0a2c9e, volume: e065f295-c515-4c2f-a278-19988f534d4b, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[74708a6e-337c-4f47-adbc-b723aa3a2910]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:33 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:33 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:33 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.580s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:33 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362 Apr 07 06:14:33 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:33 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.565s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ba1960-a3fc-4263-b996-af72eade40c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af10f3ca-2c05-41d3-8d6b-3c75451ddd3c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:34 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:34 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:34 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f.e7c660f0-48da-4b50-b047-e04da9791362" returned: 0 in 0.462s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-e7c660f0-48da-4b50-b047-e04da9791362" released by "_delete_snapshot" :: held 2.158s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" released by "delete_snapshot" :: held 2.171s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['9c6d1722-c241-484a-8304-031883d06352', 'a1f01da3-2f74-4150-9984-44c3c4066c5e', '2dd18e3f-e732-478f-a05d-a268208a8d36', 'd49b8fef-0517-4188-b6c0-825f9108ff7b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Delete snapshot completed successfully. Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-e7c660f0-48da-4b50-b047-e04da9791362-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Snapshots deleted, issuing volume delete {{(pid=83450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b6bf30-7dea-459b-a8e4-7e3cea7788f1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:34 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f Apr 07 06:14:34 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:34 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.506s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:34 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b Apr 07 06:14:34 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:34 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f" returned: 0 in 0.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:34 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f Apr 07 06:14:34 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:35 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c33d01e-884e-4744-bfea-75df463c019f" returned: 0 in 0.627s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-1c33d01e-884e-4744-bfea-75df463c019f" released by "delete_volume" :: held 1.154s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['972f4e83-91c2-4301-83ef-fcb60637a046', 'af15ac01-9d2f-4bdf-8aaf-0b3d43bb7403', '927cf41c-c1a1-4802-a588-abf898639067', 'd859c5d0-fffe-45ba-8a55-fa6211eb0dba'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:35 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:35 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:36 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.688s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Deleted volume successfully. Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7ef830e4-9c9c-4a53-bd4e-8beb74bbaeba tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-1c33d01e-884e-4744-bfea-75df463c019f-delete_volume" released by "delete_volume" :: held 6.761s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:36 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b" returned: 0 in 2.478s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eea5aeb-6685-4e15-9e6a-d322dc75714b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:37 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:37 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (eb533807-73b8-4ed6-a589-269100ebe7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db10c315-14f0-43f9-8588-9f3cbd9f25b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db10c315-14f0-43f9-8588-9f3cbd9f25b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1231330673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c166ad-6405-406b-bcaa-7fc24ffdfc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b4c6dd997a4d3985d6cda621f2f169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:37Z,use_quota=True,user_id='38f20b5329a74ee0a3a3aa55dce6e686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b47282-5693-4fc2-992d-bf5d8b75b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b47282-5693-4fc2-992d-bf5d8b75b03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d5fe00-ff27-4835-a04c-966cfb6d1cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d5fe00-ff27-4835-a04c-966cfb6d1cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c166ad-6405-406b-bcaa-7fc24ffdfc62', 'volume_name': 'volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00022585-e47a-434d-bd10-f116962b7074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00022585-e47a-434d-bd10-f116962b7074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cab099-26dc-42b3-97aa-818afa4a50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:37 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Volume a7c166ad-6405-406b-bcaa-7fc24ffdfc62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62', 'volume_size': 1} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:37 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.660s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2, size 1024.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:37 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Converted 1024.00 MB image at 413.08 MB/s Apr 07 06:14:37 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b is being set with open permissions: ugo+rw Apr 07 06:14:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:37 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b Apr 07 06:14:37 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" released by "_copy_volume_from_snapshot" :: held 4.715s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e-e065f295-c515-4c2f-a278-19988f534d4b" released by "_create_volume_from_snapshot" :: held 4.738s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.750s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1231330673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c166ad-6405-406b-bcaa-7fc24ffdfc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b4c6dd997a4d3985d6cda621f2f169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:37Z,use_quota=True,user_id='38f20b5329a74ee0a3a3aa55dce6e686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Creating volume a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:38 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 1073741824 Apr 07 06:14:38 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885d758f-d3aa-4027-afe8-8ad197ca5548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e065f295-c515-4c2f-a278-19988f534d4b', 'volume_size': 2, 'snapshot_id': 'c62e391a-0c52-4201-bafd-01072f0a2c9e'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f0362a-0296-47ca-bc80-3a800a598f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume volume-e065f295-c515-4c2f-a278-19988f534d4b (e065f295-c515-4c2f-a278-19988f534d4b): created successfully Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f0362a-0296-47ca-bc80-3a800a598f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (77d77af2-bb0e-4d8b-874f-325fccd54741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b231324a-1848-41bc-9bfd-189214cda934 tempest-VolumesSnapshotTestJSON-1113340565 None] Created volume successfully. Apr 07 06:14:38 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 1073741824" returned: 0 in 0.591s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-e065f295-c515-4c2f-a278-19988f534d4b-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-e065f295-c515-4c2f-a278-19988f534d4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:38 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:38 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478f6d7-3518-4908-83b2-8299f416bd4f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b Apr 07 06:14:38 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:39 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.441s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cab099-26dc-42b3-97aa-818afa4a50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e4d5b8-4996-4fec-8deb-4602127711a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Volume volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 (a7c166ad-6405-406b-bcaa-7fc24ffdfc62): created successfully Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e4d5b8-4996-4fec-8deb-4602127711a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (eb533807-73b8-4ed6-a589-269100ebe7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:39 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9e0f17cd-a206-47aa-8cf4-95c833ca74aa tempest-VolumesDeleteCascade-1775382060 None] Created volume successfully. Apr 07 06:14:39 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b" returned: 0 in 0.533s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:39 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b Apr 07 06:14:39 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:39 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e065f295-c515-4c2f-a278-19988f534d4b" returned: 0 in 0.427s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e065f295-c515-4c2f-a278-19988f534d4b" released by "delete_volume" :: held 0.984s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['3be534fa-2711-4111-9ef5-a252b1fa2e20', '7e41464a-c864-40f8-a719-21897f14c436', '5aa001d0-f43b-474b-a12e-b8fa6dcdd8b5', '3ef7940f-92fd-4cab-afa9-2d37d11af0f8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:39 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:39 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:40 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.417s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Deleted volume successfully. Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62ee2894-f234-4bdb-8814-cf4e2184c884 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-e065f295-c515-4c2f-a278-19988f534d4b-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Creating offline snapshot 3e0360e8-5229-4a2e-8b15-7b604d6047c7 of volume a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[458deee4-98de-4fd3-9b3f-d0e324f72454]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:40 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:40 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:40 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:40 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 1G Apr 07 06:14:40 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-c62e391a-0c52-4201-bafd-01072f0a2c9e-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-c62e391a-0c52-4201-bafd-01072f0a2c9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Deleting offline snapshot c62e391a-0c52-4201-bafd-01072f0a2c9e of volume 59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] snapshot_file for this snap is: volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e326a-cf3e-4634-a1b8-4daead4b13b1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:41 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 1G" returned: 0 in 0.493s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:41 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.507s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ba1960-a3fc-4263-b996-af72eade40c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[22980897-25af-4205-95e4-cd44b9a51fc0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:41 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 is being set with open permissions: ugo+rw Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:41 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:41 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.411s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:42 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info Apr 07 06:14:42 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.472s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:42 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e Apr 07 06:14:42 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info" returned: 0 in 0.389s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info is being set with open permissions: ugo+rw Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:42 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info Apr 07 06:14:42 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2.c62e391a-0c52-4201-bafd-01072f0a2c9e" returned: 0 in 0.392s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-c62e391a-0c52-4201-bafd-01072f0a2c9e" released by "_delete_snapshot" :: held 1.911s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" released by "delete_snapshot" :: held 1.923s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['acba0497-bba8-4207-a877-e7dedda74cdc', '4403639d-559e-4707-93e8-a8dad8788d4d', '0d61c9a7-f298-4ca8-b951-350b84f7cf05', '525aeab5-581d-4326-a061-a865f9ddf5b7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Delete snapshot completed successfully. Apr 07 06:14:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-aee1d712-3c1c-4e47-9b14-fd474332ee0e tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-c62e391a-0c52-4201-bafd-01072f0a2c9e-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:43 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.info" returned: 0 in 0.444s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:43 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c5ead13e-b0d5-4b50-a1e6-812d6321e2ea tempest-VolumesDeleteCascade-1775382060 None] Create snapshot completed successfully Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-59ba1960-a3fc-4263-b996-af72eade40c2-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-59ba1960-a3fc-4263-b996-af72eade40c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb63446-05f7-4f3c-944a-4d26d8f019fc]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:43 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:43 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.461s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2 Apr 07 06:14:43 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (feaa565f-d862-43b8-affc-bde58cf6d322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce05427-8331-41cc-9a8b-56635ed812f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce05427-8331-41cc-9a8b-56635ed812f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-529137547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bc4084-918d-4165-ace1-507f59465547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b4c6dd997a4d3985d6cda621f2f169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e0360e8-5229-4a2e-8b15-7b604d6047c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:44Z,use_quota=True,user_id='38f20b5329a74ee0a3a3aa55dce6e686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100ee66d-d9fb-466b-8b70-3e2a080366d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100ee66d-d9fb-466b-8b70-3e2a080366d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eab84df-0d4c-48a5-9357-9d7e23a98601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eab84df-0d4c-48a5-9357-9d7e23a98601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07bc4084-918d-4165-ace1-507f59465547', 'volume_name': 'volume-07bc4084-918d-4165-ace1-507f59465547', 'volume_size': 1, 'snapshot_id': '3e0360e8-5229-4a2e-8b15-7b604d6047c7'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b451adb5-7737-48a3-8988-e3bbc82b9ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b451adb5-7737-48a3-8988-e3bbc82b9ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ff78bb-816b-4899-980c-763b2e848e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:43 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Volume 07bc4084-918d-4165-ace1-507f59465547: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07bc4084-918d-4165-ace1-507f59465547', 'volume_size': 1, 'snapshot_id': '3e0360e8-5229-4a2e-8b15-7b604d6047c7'} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7-07bc4084-918d-4165-ace1-507f59465547" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7-07bc4084-918d-4165-ace1-507f59465547" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Creating volume 07bc4084-918d-4165-ace1-507f59465547 from snapshot 3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] snapshot: 3e0360e8-5229-4a2e-8b15-7b604d6047c7, volume: 07bc4084-918d-4165-ace1-507f59465547, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a7d6c-809b-497c-8b26-8fd87eab42b6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:43 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:44 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-59ba1960-a3fc-4263-b996-af72eade40c2" returned: 0 in 0.413s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-59ba1960-a3fc-4263-b996-af72eade40c2" released by "delete_volume" :: held 0.907s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['18d4db85-ee40-4a9e-9168-1a8b4cdaaf49', '47b741f4-ca9d-40a6-807e-d83554960c92', 'bddcc2ba-42cc-4794-a6ba-8688726a5bb3', '63466690-ac99-4b35-ba24-e196ee71831e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:44 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:44 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:44 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.557s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a346f8-f5df-477f-a166-33e30b9ac801]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (5dc74be0-6b88-415f-a3ce-c78324960a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d618344-10a7-449b-8bb7-42493ac5b7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:44 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:44 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d618344-10a7-449b-8bb7-42493ac5b7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-135101696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bafaaa7-30f0-4942-90d1-bba9c106b1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:44Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b148ba1-547d-4fa8-a416-bc8502eb3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b148ba1-547d-4fa8-a416-bc8502eb3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e016d07-6a1c-41dc-acd1-7e2073632083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e016d07-6a1c-41dc-acd1-7e2073632083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bafaaa7-30f0-4942-90d1-bba9c106b1ec', 'volume_name': 'volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69e6f3-1728-471d-9729-b84b4bc3e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69e6f3-1728-471d-9729-b84b4bc3e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9715b2-f410-4bce-995c-5e13f1012a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume 3bafaaa7-30f0-4942-90d1-bba9c106b1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec', 'volume_size': 1} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Deleted volume successfully. Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1af7cfb3-81b3-443a-bbdd-6fade69038c6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-59ba1960-a3fc-4263-b996-af72eade40c2-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:44 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.472s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:14:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:44 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 Apr 07 06:14:44 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:46 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:46 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:46 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547" returned: 0 in 1.929s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b1ce6-1884-43e5-9f5e-a369519bcf90]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:46 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:46 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:47 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.703s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:47 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.609s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:47 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Converted 1024.00 MB image at 530.59 MB/s Apr 07 06:14:47 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 is being set with open permissions: ugo+rw Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:47 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 Apr 07 06:14:47 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:47 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" released by "_copy_volume_from_snapshot" :: held 4.075s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7-07bc4084-918d-4165-ace1-507f59465547" released by "_create_volume_from_snapshot" :: held 4.101s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.111s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.335s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-135101696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bafaaa7-30f0-4942-90d1-bba9c106b1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:44Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating volume 3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:47 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:47 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec 1073741824 Apr 07 06:14:47 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ff78bb-816b-4899-980c-763b2e848e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bc4084-918d-4165-ace1-507f59465547', 'volume_size': 1, 'snapshot_id': '3e0360e8-5229-4a2e-8b15-7b604d6047c7'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a632a-dad9-4200-95c0-91ca299a1617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:48 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Volume volume-07bc4084-918d-4165-ace1-507f59465547 (07bc4084-918d-4165-ace1-507f59465547): created successfully Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a632a-dad9-4200-95c0-91ca299a1617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Flow 'volume_create_manager' (feaa565f-d862-43b8-affc-bde58cf6d322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-41b2d687-3917-49d6-8e9e-af5dea709cee tempest-VolumesDeleteCascade-1775382060 None] Created volume successfully. Apr 07 06:14:48 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec 1073741824" returned: 0 in 0.524s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=103,cinder:UPDATE=100,cinder:INSERT=30,cinder:DELETE=10 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=124,cinder:SELECT=100,cinder:INSERT=26,cinder:DELETE=11 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:48 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:14:48 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:48 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9715b2-f410-4bce-995c-5e13f1012a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2f5ffa-0562-4696-9ede-c5562a58412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:49 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec (3bafaaa7-30f0-4942-90d1-bba9c106b1ec): created successfully Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2f5ffa-0562-4696-9ede-c5562a58412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (5dc74be0-6b88-415f-a3ce-c78324960a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d54fa6e2-d004-48b0-a548-042bc2e54507 tempest-VolumesSnapshotTestJSON-1113340565 None] Created volume successfully. Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-a7c166ad-6405-406b-bcaa-7fc24ffdfc62-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-a7c166ad-6405-406b-bcaa-7fc24ffdfc62-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Performing cascade delete. {{(pid=83450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-3e0360e8-5229-4a2e-8b15-7b604d6047c7-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-3e0360e8-5229-4a2e-8b15-7b604d6047c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Deleting offline snapshot 3e0360e8-5229-4a2e-8b15-7b604d6047c7 of volume a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] snapshot_file for this snap is: volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5261c4-315a-4434-94f9-b0394940864a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:49 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:49 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:49 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.463s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6e7378-559e-4b7a-9c63-5524eb4a1c77]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:49 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:49 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating offline snapshot 79a92871-7d90-4383-930f-d597eada1d4f of volume 3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d12c2-b101-411b-8dac-440cddcbd126]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:14:50 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.527s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:50 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.530s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f 1G Apr 07 06:14:50 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.479s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7 Apr 07 06:14:50 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62.3e0360e8-5229-4a2e-8b15-7b604d6047c7" returned: 0 in 0.409s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-3e0360e8-5229-4a2e-8b15-7b604d6047c7" released by "_delete_snapshot" :: held 1.921s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" released by "delete_snapshot" :: held 1.932s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:51 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f 1G" returned: 0 in 0.505s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:14:51 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['04aa72cd-a899-412f-be36-facadcc6b25f', '720da83f-ffa8-4c88-8453-e89d4867f372', '36eccb35-2935-47dd-9dc6-379c2f87e624', 'fb2e3354-4c9e-4449-b59b-13edbdcc6679'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Delete snapshot completed successfully. Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-3e0360e8-5229-4a2e-8b15-7b604d6047c7-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Snapshots deleted, issuing volume delete {{(pid=83450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fd6fc-98b4-4d40-a739-9993d557231e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:51 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.453s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f is being set with open permissions: ugo+rw Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:14:51 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62 Apr 07 06:14:51 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.450s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info Apr 07 06:14:52 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" returned: 0 in 0.435s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-a7c166ad-6405-406b-bcaa-7fc24ffdfc62" released by "delete_volume" :: held 0.960s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['865224d7-6585-485c-9b0d-99c8e433c7e5', '111079fd-c6af-43cd-9e2e-156e9f000897', '2f2f5616-5caa-4332-8f2a-11ba5f1f8993', '4c973cb1-f56b-405e-9e4d-8c5007c036b2'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:52 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info is being set with open permissions: ugo+rw Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info Apr 07 06:14:52 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-07bc4084-918d-4165-ace1-507f59465547-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-07bc4084-918d-4165-ace1-507f59465547-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:52 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.424s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Deleted volume successfully. Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00d5a811-0099-4f91-8e31-4790e9ae6777 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-a7c166ad-6405-406b-bcaa-7fc24ffdfc62-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99299828-d858-474f-ae58-da380f749bab]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 Apr 07 06:14:52 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:53 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.info" returned: 0 in 0.444s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f68069eb-9c2b-4cac-ae82-63eb2494e8a6 tempest-VolumesSnapshotTestJSON-1113340565 None] Create snapshot completed successfully Apr 07 06:14:53 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547" returned: 0 in 0.548s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:53 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547 Apr 07 06:14:53 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (95378826-f72a-47d1-bc86-5969958a624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9235341e-ea46-4c49-b159-a2a8dcb31669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9235341e-ea46-4c49-b159-a2a8dcb31669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-108211624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae28079a-e4b9-48f7-b14f-dcaee39105ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3390e01fb3b4a2db6cc80d56d825ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79a92871-7d90-4383-930f-d597eada1d4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:54Z,use_quota=True,user_id='3dd40bc636bc4ec79db1f4e26d8ea315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67675e-42f6-48bd-a5e6-c8509795ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67675e-42f6-48bd-a5e6-c8509795ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001752b3-a4b5-45ba-9a2d-b1d1b24460fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001752b3-a4b5-45ba-9a2d-b1d1b24460fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae28079a-e4b9-48f7-b14f-dcaee39105ae', 'volume_name': 'volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae', 'volume_size': 1, 'snapshot_id': '79a92871-7d90-4383-930f-d597eada1d4f'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bb2cc5-e894-4ad7-8aa7-f062d2ec5114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bb2cc5-e894-4ad7-8aa7-f062d2ec5114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4428a3-5767-4f4d-9529-2b893ec3e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume ae28079a-e4b9-48f7-b14f-dcaee39105ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae', 'volume_size': 1, 'snapshot_id': '79a92871-7d90-4383-930f-d597eada1d4f'} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f-ae28079a-e4b9-48f7-b14f-dcaee39105ae" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f-ae28079a-e4b9-48f7-b14f-dcaee39105ae" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating volume ae28079a-e4b9-48f7-b14f-dcaee39105ae from snapshot 79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] snapshot: 79a92871-7d90-4383-930f-d597eada1d4f, volume: ae28079a-e4b9-48f7-b14f-dcaee39105ae, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[34344229-8505-4cf3-a647-bda4e4113b53]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:53 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-07bc4084-918d-4165-ace1-507f59465547" returned: 0 in 0.520s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-quobyte-07bc4084-918d-4165-ace1-507f59465547" released by "delete_volume" :: held 1.097s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Created reservations ['9fd0b4a9-8d5f-4ee7-84b9-267f93cf3c00', '215c53b3-2053-4cb7-bcc7-ff717fbc7368', 'bb8bc1ff-c17a-4807-bbfc-3f65cf663e55', '386efe22-2fab-49ac-b3de-ecbc4e5c7ee7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:53 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:14:53 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:54 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:14:54 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:54 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a36b553-8ad1-4bb5-8d58-e8b8430ebf89]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:54 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:14:54 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:54 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.532s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Deleted volume successfully. Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fc52e004-f1be-4997-86d5-4cbf2b9a38c6 tempest-VolumesDeleteCascade-1775382060 None] Lock "cinder-07bc4084-918d-4165-ace1-507f59465547-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:54 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.547s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:14:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:54 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae Apr 07 06:14:54 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:57 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae" returned: 0 in 2.385s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:57 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c1cfe-3802-4e2b-b566-98d82e2f6ca0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:57 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:14:57 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.657s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:58 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Converted 1024.00 MB image at 429.11 MB/s Apr 07 06:14:58 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae is being set with open permissions: ugo+rw Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:58 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae Apr 07 06:14:58 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (e3c9f8fd-c90f-4454-9b13-d111223a260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea8d656-2308-46d0-9850-9f6080c4df00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea8d656-2308-46d0-9850-9f6080c4df00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1133054604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210352fd-ae49-433e-ab43-3cdbb6e4470e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:58Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd902a1-0c6d-4f11-8c5f-c9a838487dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd902a1-0c6d-4f11-8c5f-c9a838487dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ef5c97-499e-4adf-8f36-79d692970cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ef5c97-499e-4adf-8f36-79d692970cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210352fd-ae49-433e-ab43-3cdbb6e4470e', 'volume_name': 'volume-210352fd-ae49-433e-ab43-3cdbb6e4470e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ff5b06-cf92-4533-9f5d-4641a1ce0cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ff5b06-cf92-4533-9f5d-4641a1ce0cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc3ba09-42f8-48e8-8444-ca1e196fb7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Volume 210352fd-ae49-433e-ab43-3cdbb6e4470e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210352fd-ae49-433e-ab43-3cdbb6e4470e', 'volume_size': 1} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:58 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae" returned: 0 in 0.415s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" released by "_copy_volume_from_snapshot" :: held 4.617s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f-ae28079a-e4b9-48f7-b14f-dcaee39105ae" released by "_create_volume_from_snapshot" :: held 4.653s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.665s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1133054604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210352fd-ae49-433e-ab43-3cdbb6e4470e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:58Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Creating volume 210352fd-ae49-433e-ab43-3cdbb6e4470e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:58 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:58 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e 1073741824 Apr 07 06:14:58 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4428a3-5767-4f4d-9529-2b893ec3e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae', 'volume_size': 1, 'snapshot_id': '79a92871-7d90-4383-930f-d597eada1d4f'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2df38-7109-4f00-87f8-734937fb4563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:58 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Volume volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae (ae28079a-e4b9-48f7-b14f-dcaee39105ae): created successfully Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2df38-7109-4f00-87f8-734937fb4563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Flow 'volume_create_manager' (95378826-f72a-47d1-bc86-5969958a624e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-62718800-0066-4916-aa92-8e2e98f6ef52 tempest-VolumesSnapshotTestJSON-1113340565 None] Created volume successfully. Apr 07 06:14:58 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e 1073741824" returned: 0 in 0.512s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:58 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e Apr 07 06:14:58 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-ae28079a-e4b9-48f7-b14f-dcaee39105ae-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-ae28079a-e4b9-48f7-b14f-dcaee39105ae-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7997fd-3fb4-4238-865b-3e53c84b8484]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae Apr 07 06:14:59 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e" returned: 0 in 0.431s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc3ba09-42f8-48e8-8444-ca1e196fb7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210352fd-ae49-433e-ab43-3cdbb6e4470e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a2239d-ae46-4d32-9079-e2807e76e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Volume volume-210352fd-ae49-433e-ab43-3cdbb6e4470e (210352fd-ae49-433e-ab43-3cdbb6e4470e): created successfully Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a2239d-ae46-4d32-9079-e2807e76e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (e3c9f8fd-c90f-4454-9b13-d111223a260c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dbc54b3d-1a19-4ae3-914d-b581ddc4d723 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:14:59 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae" returned: 0 in 0.496s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae Apr 07 06:14:59 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ae28079a-e4b9-48f7-b14f-dcaee39105ae" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-ae28079a-e4b9-48f7-b14f-dcaee39105ae" released by "delete_volume" :: held 0.957s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['1e3f4144-e583-4ba6-bb4c-c5812f22eea8', '5c510db9-83a9-4552-9199-ed118df035e3', '8b2c934f-0646-4d1f-b184-078a53fd61c2', '3d7a774c-f989-4f00-9b28-79003800ffef'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:00 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-79a92871-7d90-4383-930f-d597eada1d4f-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-79a92871-7d90-4383-930f-d597eada1d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Deleting offline snapshot 79a92871-7d90-4383-930f-d597eada1d4f of volume 3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] snapshot_file for this snap is: volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77013a2-190a-47d4-8180-73ff51903f3b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:15:00 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.469s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Deleted volume successfully. Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27a3c249-1bb5-4afd-98dc-e92a7b7de18c tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-ae28079a-e4b9-48f7-b14f-dcaee39105ae-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (0ff9373a-24c5-4534-8b10-40078ab57ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1ac86-ad50-4ec9-8687-80ad3a3369a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1ac86-ad50-4ec9-8687-80ad3a3369a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1621131813',display_name='tempest-VolumesGetTest-Volume-1284028836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8c4c6a-5262-4616-bbd9-d682a2df8580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:01Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5217e933-fdcd-4896-be88-be9de07117b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5217e933-fdcd-4896-be88-be9de07117b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f675c2fb-b6bd-4023-8755-61ec9f904b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f675c2fb-b6bd-4023-8755-61ec9f904b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8c4c6a-5262-4616-bbd9-d682a2df8580', 'volume_name': 'volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6012f2-0206-4bd0-ae23-62dda09a8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6012f2-0206-4bd0-ae23-62dda09a8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cfaade-1c32-4591-bd64-23649ed95a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:00 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Volume 4b8c4c6a-5262-4616-bbd9-d682a2df8580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580', 'volume_size': 1} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1621131813',display_name='tempest-VolumesGetTest-Volume-1284028836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8c4c6a-5262-4616-bbd9-d682a2df8580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:01Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Creating volume 4b8c4c6a-5262-4616-bbd9-d682a2df8580 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:00 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 1073741824 Apr 07 06:15:00 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[848413eb-b369-46da-8d56-4b67f436b4a2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:15:01 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 1073741824" returned: 0 in 0.498s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 Apr 07 06:15:01 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:15:01 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cfaade-1c32-4591-bd64-23649ed95a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906312b7-43f6-4c7d-bc19-259698ad7db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Volume volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 (4b8c4c6a-5262-4616-bbd9-d682a2df8580): created successfully Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906312b7-43f6-4c7d-bc19-259698ad7db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (0ff9373a-24c5-4534-8b10-40078ab57ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:01 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-344120ab-093f-496c-a167-b297ceb67c56 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:01 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.480s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f Apr 07 06:15:01 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:02 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec.79a92871-7d90-4383-930f-d597eada1d4f" returned: 0 in 0.384s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-79a92871-7d90-4383-930f-d597eada1d4f" released by "_delete_snapshot" :: held 1.951s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" released by "delete_snapshot" :: held 1.968s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['918d7c14-5638-475d-a37e-356f715edc35', 'a159a431-aee0-4ba9-85c8-60fda9e96172', '49154386-1b9a-4213-96b9-f9ac88179d58', 'a8eb1eb6-8f15-4c9e-85a1-d4bac206b1c5'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Delete snapshot completed successfully. Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-093e1869-b67f-4093-a1d0-bb9a7f732529 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-79a92871-7d90-4383-930f-d597eada1d4f-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-3bafaaa7-30f0-4942-90d1-bba9c106b1ec-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-3bafaaa7-30f0-4942-90d1-bba9c106b1ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3319ca42-cece-4fe3-a808-f9dfb4d7d7f2]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:02 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:15:02 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-4b8c4c6a-5262-4616-bbd9-d682a2df8580-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "cinder-4b8c4c6a-5262-4616-bbd9-d682a2df8580-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-4b8c4c6a-5262-4616-bbd9-d682a2df8580" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-4b8c4c6a-5262-4616-bbd9-d682a2df8580" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e72af-df7c-45af-891d-0a608c84d49c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.488s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec Apr 07 06:15:03 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 Apr 07 06:15:03 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" returned: 0 in 0.452s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-3bafaaa7-30f0-4942-90d1-bba9c106b1ec" released by "delete_volume" :: held 0.978s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:03 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580 Apr 07 06:15:03 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['f95da416-3b63-4e4c-a063-dc5fc48fd5f7', 'e16250b8-9480-49be-96d0-c76ee1e14b5b', '974886ad-4f7f-499d-88d8-e76b6ff478f7', 'e6d79893-a1ce-4c5e-a9b9-fc28023139f8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:03 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4b8c4c6a-5262-4616-bbd9-d682a2df8580" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-4b8c4c6a-5262-4616-bbd9-d682a2df8580" released by "delete_volume" :: held 0.926s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Created reservations ['cc990d7f-fa77-4c46-8784-79d813af6adf', 'dac6eb55-d754-4a78-a59c-cab7de7c50e7', '9548b4a5-3e48-41a6-adb9-0f28ca3e25d0', '856fe09f-b8eb-443d-8793-fba709d59c6b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:04 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.446s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Deleted volume successfully. Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5693f5ae-4d2e-432f-8c0a-cea0096ec700 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-3bafaaa7-30f0-4942-90d1-bba9c106b1ec-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-210352fd-ae49-433e-ab43-3cdbb6e4470e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "cinder-210352fd-ae49-433e-ab43-3cdbb6e4470e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-210352fd-ae49-433e-ab43-3cdbb6e4470e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-210352fd-ae49-433e-ab43-3cdbb6e4470e" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7097a75d-969f-460f-9b53-362650b4a9b9]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e Apr 07 06:15:04 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.430s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-cf124e72-68a6-46c1-93dd-438f8b2a7aac tempest-VolumesGetTest-1623778177 None] Lock "cinder-4b8c4c6a-5262-4616-bbd9-d682a2df8580-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:04 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e" returned: 0 in 0.473s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e Apr 07 06:15:04 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-e6c91f57-acc4-43a1-a636-93dd24391275-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-e6c91f57-acc4-43a1-a636-93dd24391275-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910f026-2ba0-496b-adf1-bf3df70fd642]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 Apr 07 06:15:04 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-210352fd-ae49-433e-ab43-3cdbb6e4470e" returned: 0 in 0.446s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-210352fd-ae49-433e-ab43-3cdbb6e4470e" released by "delete_volume" :: held 0.940s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Created reservations ['9f4131ac-44d9-4c4c-b9ed-5e375b4f5f37', '90724ead-13d9-4303-9e82-7756fdeff223', '9a18cc65-4c37-4460-9ec4-dd9dad833140', 'd80b5328-e43d-4b95-9180-3cedf5ecf640'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:05 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:05 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275" returned: 0 in 0.517s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:05 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275 Apr 07 06:15:05 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (496150a0-b4b5-4332-bcd1-0bf7d0f40a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097585d7-d526-4dbe-9104-5be5fafa8cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097585d7-d526-4dbe-9104-5be5fafa8cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d7fb46-decc-4333-9740-8d9278e90fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:06Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b137d54b-7c7a-483e-a29b-0a14e2eec517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b137d54b-7c7a-483e-a29b-0a14e2eec517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcf92fb-c32b-4cf0-b1b5-324529d5a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcf92fb-c32b-4cf0-b1b5-324529d5a949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d7fb46-decc-4333-9740-8d9278e90fe5', 'volume_name': 'volume-97d7fb46-decc-4333-9740-8d9278e90fe5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50075d80-77b9-4555-befb-19927d0b66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50075d80-77b9-4555-befb-19927d0b66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295687e-1a16-40d0-8dcb-bc0f8ff3e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:05 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Volume 97d7fb46-decc-4333-9740-8d9278e90fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d7fb46-decc-4333-9740-8d9278e90fe5', 'volume_size': 1} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d7fb46-decc-4333-9740-8d9278e90fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:06Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Creating volume 97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:05 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:05 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 1073741824 Apr 07 06:15:05 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.443s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:05 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-fee43f5b-7f1c-4300-9729-ccfbbf75be4d tempest-VolumesGetTest-1623778177 None] Lock "cinder-210352fd-ae49-433e-ab43-3cdbb6e4470e-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:05 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e6c91f57-acc4-43a1-a636-93dd24391275" returned: 0 in 0.523s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-quobyte-e6c91f57-acc4-43a1-a636-93dd24391275" released by "delete_volume" :: held 1.070s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Created reservations ['d1cf921e-cb35-4b5a-87da-01ff838eeb10', 'd7c3f38f-309b-493e-9cc0-26c6616b22e3', '35945be5-eeea-4889-9260-375a93086f8b', 'cdac0c11-b32f-492f-ad41-872e766ee058'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:06 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:06 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:06 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 1073741824" returned: 0 in 0.510s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:06 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:06 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:06 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.434s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:06 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Deleted volume successfully. Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c0171d79-1270-4528-a43c-f832cfabfd22 tempest-VolumesSnapshotTestJSON-1113340565 None] Lock "cinder-e6c91f57-acc4-43a1-a636-93dd24391275-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:06 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.398s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295687e-1a16-40d0-8dcb-bc0f8ff3e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d7fb46-decc-4333-9740-8d9278e90fe5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371be3a-37ca-46a4-a643-f29c2411374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:06 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Volume volume-97d7fb46-decc-4333-9740-8d9278e90fe5 (97d7fb46-decc-4333-9740-8d9278e90fe5): created successfully Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371be3a-37ca-46a4-a643-f29c2411374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:06 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (496150a0-b4b5-4332-bcd1-0bf7d0f40a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:06 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-76af4305-0c3a-4fe1-a771-be975d55556f tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (f5c02425-eaa6-4092-ae9e-8d30f1f7c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d05bab-b82c-4b58-9e7c-3e750e7f3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d05bab-b82c-4b58-9e7c-3e750e7f3884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1201880746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f87422-883c-46c4-a5f0-da250c3fc22f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=97d7fb46-decc-4333-9740-8d9278e90fe5,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:08Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd94313d-df11-4b06-9f27-a4ddf3cb6ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd94313d-df11-4b06-9f27-a4ddf3cb6ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e63f36c-5969-44e3-a712-8bf7debcca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e63f36c-5969-44e3-a712-8bf7debcca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '87f87422-883c-46c4-a5f0-da250c3fc22f', 'volume_name': 'volume-87f87422-883c-46c4-a5f0-da250c3fc22f', 'volume_size': 1, 'source_volid': '97d7fb46-decc-4333-9740-8d9278e90fe5', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc70047-6243-414c-b19c-2f64d23d67f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc70047-6243-414c-b19c-2f64d23d67f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46a7fcd-e815-413a-9a58-4388b63818ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Volume 87f87422-883c-46c4-a5f0-da250c3fc22f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-87f87422-883c-46c4-a5f0-da250c3fc22f', 'volume_size': 1, 'source_volid': '97d7fb46-decc-4333-9740-8d9278e90fe5', 'source_volstatus': 'available'} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:08 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Cloning volume 97d7fb46-decc-4333-9740-8d9278e90fe5 to volume 87f87422-883c-46c4-a5f0-da250c3fc22f Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Creating offline snapshot 37db5712-4640-4610-8b6c-ccd9e458c0d6 of volume 97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a63ee-7780-42fd-b384-f4fe3d5fd57d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:08 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:08 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:08 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.498s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:08 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 1G Apr 07 06:15:08 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:09 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 1G" returned: 0 in 0.577s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97d7fb46-decc-4333-9740-8d9278e90fe5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:09 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97d7fb46-decc-4333-9740-8d9278e90fe5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:09 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:09 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97d7fb46-decc-4333-9740-8d9278e90fe5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.467s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:09 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 is being set with open permissions: ugo+rw Apr 07 06:15:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:09 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:09 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:10 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:10 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info Apr 07 06:15:10 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:10 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info" returned: 0 in 0.412s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:10 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info is being set with open permissions: ugo+rw Apr 07 06:15:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:10 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info Apr 07 06:15:10 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:11 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.info" returned: 0 in 0.450s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] snapshot: 37db5712-4640-4610-8b6c-ccd9e458c0d6, volume: 87f87422-883c-46c4-a5f0-da250c3fc22f, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4778e-50e3-4e94-84f4-c470dafa6b72]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Flow 'volume_create_manager' (78836ced-b683-4ea2-a95e-aa542c63a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d731287e-5f2f-4f3a-b371-7db09887739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d731287e-5f2f-4f3a-b371-7db09887739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1273963536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f89ce-80d2-473b-9606-115b275b4731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225bfd61eba4b39be882d272865c0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:11Z,use_quota=True,user_id='11e59ee3f30f42b68c73acaddb7f4e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54edf94-90a1-4f77-8785-e4fd6640211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54edf94-90a1-4f77-8785-e4fd6640211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd51abcb-a7ce-4cd6-b282-70f7533808ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:11 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:11 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd51abcb-a7ce-4cd6-b282-70f7533808ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0f89ce-80d2-473b-9606-115b275b4731', 'volume_name': 'volume-0c0f89ce-80d2-473b-9606-115b275b4731', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914314b1-f9ea-4487-86e7-bf72e5b65114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914314b1-f9ea-4487-86e7-bf72e5b65114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a27910-5693-4905-901e-8af5ef4bc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Volume 0c0f89ce-80d2-473b-9606-115b275b4731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0f89ce-80d2-473b-9606-115b275b4731', 'volume_size': 1} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:11 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.447s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97d7fb46-decc-4333-9740-8d9278e90fe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c6658-976b-43b7-b10d-e0a7d895b2e4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:11 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:11 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:12 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.444s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:12 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:15:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:12 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f Apr 07 06:15:12 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:14 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f" returned: 0 in 2.076s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb2960d-abb8-4e68-b373-dbe37c634129]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:14 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:14 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:14 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.622s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:15:14 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Converted 1024.00 MB image at 492.90 MB/s Apr 07 06:15:14 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f is being set with open permissions: ugo+rw Apr 07 06:15:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:14 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f Apr 07 06:15:14 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:15 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f" returned: 0 in 0.376s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" released by "_copy_volume_from_snapshot" :: held 4.022s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-37db5712-4640-4610-8b6c-ccd9e458c0d6" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-37db5712-4640-4610-8b6c-ccd9e458c0d6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Deleting offline snapshot 37db5712-4640-4610-8b6c-ccd9e458c0d6 of volume 97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] snapshot_file for this snap is: volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3128f-25b3-4d59-a086-036d414d9636]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:15 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:15 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:15 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.496s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97d7fb46-decc-4333-9740-8d9278e90fe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6feeb4b-05e1-47ce-9329-91459d9e88df]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:15 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:15 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:16 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:16 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:16 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:16 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.506s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:16 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6 Apr 07 06:15:16 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:17 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5.37db5712-4640-4610-8b6c-ccd9e458c0d6" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-37db5712-4640-4610-8b6c-ccd9e458c0d6" released by "_delete_snapshot" :: held 1.976s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.979s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.931s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1273963536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f89ce-80d2-473b-9606-115b275b4731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225bfd61eba4b39be882d272865c0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:11Z,use_quota=True,user_id='11e59ee3f30f42b68c73acaddb7f4e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Creating volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:17 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46a7fcd-e815-413a-9a58-4388b63818ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f87422-883c-46c4-a5f0-da250c3fc22f', 'volume_size': 1, 'source_volid': '97d7fb46-decc-4333-9740-8d9278e90fe5', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ae4d36-22ed-400d-b670-4b3eb7beae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:17 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 1073741824 Apr 07 06:15:17 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Volume volume-87f87422-883c-46c4-a5f0-da250c3fc22f (87f87422-883c-46c4-a5f0-da250c3fc22f): created successfully Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ae4d36-22ed-400d-b670-4b3eb7beae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (f5c02425-eaa6-4092-ae9e-8d30f1f7c68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-00e90499-2992-4d90-8640-0ab11b1b1d25 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:17 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 1073741824" returned: 0 in 0.541s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:17 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 Apr 07 06:15:17 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (5a32f43c-01a1-4762-87dc-f4fb828589d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:18 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78acd37a-3ec1-497d-b5c9-87daf33dc1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78acd37a-3ec1-497d-b5c9-87daf33dc1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1924569382',display_name='tempest-VolumesGetTest-Volume-1214532848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d23398-781a-46c1-975b-f5940085b743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:18Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e70396-bf60-4751-a040-39186cd9846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e70396-bf60-4751-a040-39186cd9846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89952843-9fb9-4be7-b52b-660a07cf4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89952843-9fb9-4be7-b52b-660a07cf4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d23398-781a-46c1-975b-f5940085b743', 'volume_name': 'volume-a4d23398-781a-46c1-975b-f5940085b743', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692f11c6-1ce6-4592-aa90-ec752e7708a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692f11c6-1ce6-4592-aa90-ec752e7708a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cc7e63-a2b0-4727-94a0-3c9bb1a494a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Volume a4d23398-781a-46c1-975b-f5940085b743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d23398-781a-46c1-975b-f5940085b743', 'volume_size': 1} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1924569382',display_name='tempest-VolumesGetTest-Volume-1214532848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d23398-781a-46c1-975b-f5940085b743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:18Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Creating volume a4d23398-781a-46c1-975b-f5940085b743 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:18 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a27910-5693-4905-901e-8af5ef4bc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0f89ce-80d2-473b-9606-115b275b4731', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60c5376-d321-48db-88e9-d757e0596100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:18 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 1073741824 Apr 07 06:15:18 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:18 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Volume volume-0c0f89ce-80d2-473b-9606-115b275b4731 (0c0f89ce-80d2-473b-9606-115b275b4731): created successfully Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60c5376-d321-48db-88e9-d757e0596100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Flow 'volume_create_manager' (78836ced-b683-4ea2-a95e-aa542c63a22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-67229734-3c2e-4888-9c01-62ed28f5cac1 tempest-VolumesSnapshotListTestJSON-512116753 None] Created volume successfully. Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:18 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 1073741824" returned: 0 in 0.560s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:18 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 Apr 07 06:15:18 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:19 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.659s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cc7e63-a2b0-4727-94a0-3c9bb1a494a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d23398-781a-46c1-975b-f5940085b743', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222934b3-2039-4df5-a9f3-56a28f3213d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Creating offline snapshot c8140ddd-7a4f-45b1-b218-53534aab1aed of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:19 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Volume volume-a4d23398-781a-46c1-975b-f5940085b743 (a4d23398-781a-46c1-975b-f5940085b743): created successfully Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222934b3-2039-4df5-a9f3-56a28f3213d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (5a32f43c-01a1-4762-87dc-f4fb828589d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[433515dc-b4ac-484b-9037-89bc232c6e63]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:19 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-293df15a-a052-40af-bf6b-8f2dc56ff1b4 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:19 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 Apr 07 06:15:19 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:19 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:19 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed 1G Apr 07 06:15:19 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:20 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed 1G" returned: 0 in 0.538s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:20 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:20 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-a4d23398-781a-46c1-975b-f5940085b743-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "cinder-a4d23398-781a-46c1-975b-f5940085b743-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-a4d23398-781a-46c1-975b-f5940085b743" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-a4d23398-781a-46c1-975b-f5940085b743" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6431a4c-6944-4417-923d-b8eb5c5ded11]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:20 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 Apr 07 06:15:20 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:20 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.512s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:20 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed is being set with open permissions: ugo+rw Apr 07 06:15:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:20 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:20 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:21 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743" returned: 0 in 0.515s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:21 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743 Apr 07 06:15:21 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:21 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:21 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info Apr 07 06:15:21 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:21 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a4d23398-781a-46c1-975b-f5940085b743" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-a4d23398-781a-46c1-975b-f5940085b743" released by "delete_volume" :: held 0.984s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Created reservations ['c01bded2-2971-4052-9da3-4cef51333e75', '0e6c40a6-0d0b-43eb-b201-d2a06408b639', 'f8783367-47a7-43cf-9d16-c9693596ff8f', 'faf3d30f-4397-44d7-a8dc-6f21bb6e978e'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:21 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:21 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:21 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info" returned: 0 in 0.440s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:21 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info is being set with open permissions: ugo+rw Apr 07 06:15:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:21 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info Apr 07 06:15:21 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:22 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.416s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-1d2c8869-2fe0-4b82-9fd5-bbb33e00f502 tempest-VolumesGetTest-1623778177 None] Lock "cinder-a4d23398-781a-46c1-975b-f5940085b743-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:22 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.info" returned: 0 in 0.419s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-49fb62a2-7876-411a-920c-5a526dec4c55 tempest-VolumesSnapshotListTestJSON-512116753 None] Create snapshot completed successfully Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-87f87422-883c-46c4-a5f0-da250c3fc22f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "cinder-87f87422-883c-46c4-a5f0-da250c3fc22f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af888cab-078c-4359-9a7e-8a2e58a99a7f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:22 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f Apr 07 06:15:22 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Creating offline snapshot c02d2032-21b7-449e-9434-ad25c531deb1 of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:22 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ddf4f-937b-493e-a153-365e00c3b92e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:23 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:23 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:23 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f" returned: 0 in 0.571s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:23 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f Apr 07 06:15:23 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:23 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:23 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 1G Apr 07 06:15:23 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:23 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-87f87422-883c-46c4-a5f0-da250c3fc22f" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-87f87422-883c-46c4-a5f0-da250c3fc22f" released by "delete_volume" :: held 1.054s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Created reservations ['d309b2c0-ad91-4cfc-8180-8aaf05495f32', '36fe4c42-ca07-4551-af6a-afcccd2d9352', '3495ac09-3ae4-4a13-a33b-ee9910c96f69', '38f1d181-659a-4871-a55e-aed472751f10'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:23 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:23 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:24 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 1G" returned: 0 in 0.547s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:24 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:24 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:24 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.462s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-ee639a05-c5af-4b4b-aebe-5fc86a7b9ef8 tempest-VolumesGetTest-1623778177 None] Lock "cinder-87f87422-883c-46c4-a5f0-da250c3fc22f-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:24 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.441s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 is being set with open permissions: ugo+rw Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:24 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:24 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:24 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.410s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-97d7fb46-decc-4333-9740-8d9278e90fe5-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "cinder-97d7fb46-decc-4333-9740-8d9278e90fe5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0f8f1bab-1f14-49cf-810b-7bc442953e67 tempest-VolumesSnapshotListTestJSON-512116753 None] Create snapshot completed successfully Apr 07 06:15:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-97d7fb46-decc-4333-9740-8d9278e90fe5" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-97d7fb46-decc-4333-9740-8d9278e90fe5" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03bfc3-69ad-4df4-a0f9-0960e197184b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:25 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Creating offline snapshot 0c615a4b-b755-4dc0-b7d6-659e3b386787 of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eca15b-2e93-4b1b-bd12-4485c4e0f936]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:25 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:25 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.566s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5 Apr 07 06:15:25 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:25 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.514s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 1G Apr 07 06:15:25 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:26 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-97d7fb46-decc-4333-9740-8d9278e90fe5" returned: 0 in 0.482s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-97d7fb46-decc-4333-9740-8d9278e90fe5" released by "delete_volume" :: held 1.081s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Created reservations ['0d914ef8-d40a-407c-a4c2-e970f70b4846', '8853dabb-a47c-4101-8013-cc835237dfe0', '4579f29a-320a-44c0-8996-1e8b8ba6e66b', '8083736f-a241-4541-8d66-5d5f532a313a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:26 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:26 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:26 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 1G" returned: 0 in 0.579s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:26 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 Apr 07 06:15:26 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:26 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.402s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-52c1acc3-68d7-4a50-ac4b-b27edea91d7c tempest-VolumesGetTest-1623778177 None] Lock "cinder-97d7fb46-decc-4333-9740-8d9278e90fe5-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:26 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787" returned: 0 in 0.476s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 is being set with open permissions: ugo+rw Apr 07 06:15:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:26 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 Apr 07 06:15:26 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:27 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787" returned: 0 in 0.415s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:27 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b48159ba-240f-43c5-91ac-c979df6d8331 tempest-VolumesSnapshotListTestJSON-512116753 None] Create snapshot completed successfully Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (7c6d36df-6e05-416e-8327-0b13e46f5960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1914da-9d65-43e5-b460-cc17688dcaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1914da-9d65-43e5-b460-cc17688dcaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-156142616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efad03a9-d0fc-44cf-8cdd-9d5822df5b98,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:28Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27806754-cacc-4db3-88ff-19aeebce3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27806754-cacc-4db3-88ff-19aeebce3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa80cfb-1fb5-47af-ae02-0aed238345f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.image.glance [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Creating Keystone auth plugin from conf {{(pid=83450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa80cfb-1fb5-47af-ae02-0aed238345f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efad03a9-d0fc-44cf-8cdd-9d5822df5b98', 'volume_name': 'volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408ca1a1-7247-4a8d-886a-ec994a2ea08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408ca1a1-7247-4a8d-886a-ec994a2ea08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265f389-92eb-4f92-9f2d-a9342a80088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:15:27 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Trying to clone efad03a9-d0fc-44cf-8cdd-9d5822df5b98 from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]). {{(pid=83450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:15:28 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae17bb-f71f-4227-8012-453320e69bc5]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:28 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD Apr 07 06:15:28 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:28 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc is fetched for user ab87b9ebf196499d9c48cdf048047547. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5180d63d-f081-4424-bb99-a5ff5605467e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:28 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD Apr 07 06:15:28 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-156142616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efad03a9-d0fc-44cf-8cdd-9d5822df5b98,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:28Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Creating volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:29 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1073741824 Apr 07 06:15:29 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-0c615a4b-b755-4dc0-b7d6-659e3b386787-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-0c615a4b-b755-4dc0-b7d6-659e3b386787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-0c615a4b-b755-4dc0-b7d6-659e3b386787" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c615a4b-b755-4dc0-b7d6-659e3b386787" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Deleting offline snapshot 0c615a4b-b755-4dc0-b7d6-659e3b386787 of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] snapshot_file for this snap is: volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c33a684-463b-45ba-82a7-d1b6a47bddd6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 Apr 07 06:15:29 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1073741824" returned: 0 in 0.516s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:29 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787" returned: 0 in 0.527s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a0e65-5c10-4dd6-8b33-8b71830ce7ed]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:29 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 0 in 0.440s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Attempting download of 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe00a1ec-dfd5-4af4-9614-189fb4797745]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:30 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 Apr 07 06:15:30 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb Apr 07 06:15:30 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787" returned: 0 in 0.559s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787 Apr 07 06:15:30 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb" returned: 1 in 0.519s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_55qnhzzb' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da621354-e9e7-49c1-8571-ae9beb2577cc]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:31 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD Apr 07 06:15:31 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.0c615a4b-b755-4dc0-b7d6-659e3b386787" returned: 0 in 0.429s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c615a4b-b755-4dc0-b7d6-659e3b386787" released by "_delete_snapshot" :: held 2.077s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" released by "delete_snapshot" :: held 2.092s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Created reservations ['f57ca696-86f8-4d54-9bdc-654214f40c20', 'e8fe6726-7d5e-45f6-bb57-da05f1f7fa09', 'c973fe61-aecc-404c-81e3-39c336563d01', '87f30065-4885-49ba-beac-9a0b0b227602'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:31 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Delete snapshot completed successfully. Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-178e7867-5cfa-4c73-9925-c444b5896588 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-0c615a4b-b755-4dc0-b7d6-659e3b386787-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:31 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] 3faa4fff-5dff-4870-8eaf-1bcce5af47fc was qcow2, converting to raw {{(pid=83450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:15:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:31 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:31 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-c02d2032-21b7-449e-9434-ad25c531deb1-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-c02d2032-21b7-449e-9434-ad25c531deb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-c02d2032-21b7-449e-9434-ad25c531deb1" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-c02d2032-21b7-449e-9434-ad25c531deb1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Deleting offline snapshot c02d2032-21b7-449e-9434-ad25c531deb1 of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] snapshot_file for this snap is: volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[84677279-f673-4902-a86d-9873fb357952]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:32 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 0 in 0.880s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3faa4fff-5dff-4870-8eaf-1bcce5af47fc_7v_bxmjwdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:15:32 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Converted 112.00 MB image at 112.00 MB/s Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1G Apr 07 06:15:32 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.508s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[25353cf3-70a7-4162-8669-6dfb2ae93904]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:32 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 1G" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff844c3-b2b4-473c-aa6a-2325f6cf7860]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:33 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:33 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.498s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:33 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:33 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:33 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:33 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.529s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1 Apr 07 06:15:33 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:34 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 1 in 0.506s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Downloaded image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc ((None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}])) to volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98 successfully. {{(pid=83450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Temporary image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc for user ab87b9ebf196499d9c48cdf048047547 is deleted. {{(pid=83450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.volume_utils [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Marking volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98 as bootable. {{(pid=83450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Copying metadata from image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc to efad03a9-d0fc-44cf-8cdd-9d5822df5b98. {{(pid=83450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Creating volume glance metadata for volume efad03a9-d0fc-44cf-8cdd-9d5822df5b98 backed by image 3faa4fff-5dff-4870-8eaf-1bcce5af47fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265f389-92eb-4f92-9f2d-a9342a80088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98', 'volume_size': 1, 'image_id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43e3ebc5e1df43e48a284e64e18686cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3faa4fff-5dff-4870-8eaf-1bcce5af47fc', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3faa4fff-5dff-4870-8eaf-1bcce5af47fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbb54f0-e14d-410d-912d-7086d2e22c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Volume volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 (efad03a9-d0fc-44cf-8cdd-9d5822df5b98): created successfully Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbb54f0-e14d-410d-912d-7086d2e22c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (7c6d36df-6e05-416e-8327-0b13e46f5960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9fb89105-bce8-4324-848d-8325d28b7a17 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:34 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c02d2032-21b7-449e-9434-ad25c531deb1" returned: 0 in 0.445s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-c02d2032-21b7-449e-9434-ad25c531deb1" released by "_delete_snapshot" :: held 2.041s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" released by "delete_snapshot" :: held 2.057s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Created reservations ['7e90612d-1c48-4587-adfa-0b92fc8ea764', 'b9241384-d7c5-478f-9d54-79e65192e928', '36bfc613-625a-486e-aa6b-c149282260d7', '21b4fe58-1326-4c19-9117-32b25c66c1bb'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Delete snapshot completed successfully. Apr 07 06:15:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7abe59d6-3044-4dad-af6d-4d6167c9f24a tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-c02d2032-21b7-449e-9434-ad25c531deb1-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (cfe985de-1926-4368-a24f-678e72393015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703aec9a-3126-4577-9861-8663272cf0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-c8140ddd-7a4f-45b1-b218-53534aab1aed-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703aec9a-3126-4577-9861-8663272cf0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-596918174',display_name='tempest-VolumesGetTest-Volume-894444344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc509e8-754f-473e-bc8f-375840306d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:35Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17fdfd0-770d-4436-9095-c8a4693c25e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17fdfd0-770d-4436-9095-c8a4693c25e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8c3877-198a-4b40-9ad9-eacea72c4787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8c3877-198a-4b40-9ad9-eacea72c4787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc509e8-754f-473e-bc8f-375840306d10', 'volume_name': 'volume-6fc509e8-754f-473e-bc8f-375840306d10', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492e2960-a817-4d97-9228-161c48518487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492e2960-a817-4d97-9228-161c48518487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c86d18-f351-4f9c-94f3-fed320ab4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:35 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Volume 6fc509e8-754f-473e-bc8f-375840306d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc509e8-754f-473e-bc8f-375840306d10', 'volume_size': 1} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-596918174',display_name='tempest-VolumesGetTest-Volume-894444344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc509e8-754f-473e-bc8f-375840306d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905716914abb4aae896988b01d5728a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:35Z,use_quota=True,user_id='ab87b9ebf196499d9c48cdf048047547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Creating volume 6fc509e8-754f-473e-bc8f-375840306d10 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:35 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-c8140ddd-7a4f-45b1-b218-53534aab1aed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:35 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 1073741824 Apr 07 06:15:35 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-c8140ddd-7a4f-45b1-b218-53534aab1aed" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-c8140ddd-7a4f-45b1-b218-53534aab1aed" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Deleting offline snapshot c8140ddd-7a4f-45b1-b218-53534aab1aed of volume 0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] snapshot_file for this snap is: volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6af9d-622d-44b7-a534-5fb1fa9aae67]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:35 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:36 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 1073741824" returned: 0 in 0.557s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.535s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c0f89ce-80d2-473b-9606-115b275b4731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:36 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 Apr 07 06:15:36 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd25f68d-42fa-4605-84d3-49af8cccfcd4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:36 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 Apr 07 06:15:36 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:36 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10" returned: 0 in 0.432s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c86d18-f351-4f9c-94f3-fed320ab4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc509e8-754f-473e-bc8f-375840306d10', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691b9871-f5d3-42c2-a41d-17947be594a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Volume volume-6fc509e8-754f-473e-bc8f-375840306d10 (6fc509e8-754f-473e-bc8f-375840306d10): created successfully Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691b9871-f5d3-42c2-a41d-17947be594a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Flow 'volume_create_manager' (cfe985de-1926-4368-a24f-678e72393015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dc7ebfd7-510f-4e3a-a867-f5d234368170 tempest-VolumesGetTest-1623778177 None] Created volume successfully. Apr 07 06:15:36 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731" returned: 0 in 0.514s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:36 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:36 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed Apr 07 06:15:37 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731.c8140ddd-7a4f-45b1-b218-53534aab1aed" returned: 0 in 0.480s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-c8140ddd-7a4f-45b1-b218-53534aab1aed" released by "_delete_snapshot" :: held 2.106s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" released by "delete_snapshot" :: held 2.126s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-6fc509e8-754f-473e-bc8f-375840306d10-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "cinder-6fc509e8-754f-473e-bc8f-375840306d10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-6fc509e8-754f-473e-bc8f-375840306d10" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-6fc509e8-754f-473e-bc8f-375840306d10" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Created reservations ['f256622a-5e6b-4ae3-a332-a7758d6821d1', '07ae6cfc-f4e3-4be5-bf82-024e6eeef2f6', '30518617-eb37-4408-a987-fcde1c4a3647', 'cba4b673-c294-4823-8a34-682b3a9685c0'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f0a5ed-7786-461b-9139-2961187027ca]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Delete snapshot completed successfully. Apr 07 06:15:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-06169a12-5f81-49ae-914c-3f2cca685bbc tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-c8140ddd-7a4f-45b1-b218-53534aab1aed-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:37 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 Apr 07 06:15:37 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:38 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10" returned: 0 in 0.505s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:38 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10 Apr 07 06:15:38 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-0c0f89ce-80d2-473b-9606-115b275b4731-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-0c0f89ce-80d2-473b-9606-115b275b4731-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16a281-7996-46a4-909b-0b796095fb70]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:38 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6fc509e8-754f-473e-bc8f-375840306d10" returned: 0 in 0.464s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-6fc509e8-754f-473e-bc8f-375840306d10" released by "delete_volume" :: held 1.002s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Created reservations ['92432fa7-9a47-40fc-9d26-a8ddc4339122', '37617302-f0e4-451c-9051-3800d7d80f8a', 'fd1d37b6-a3f8-46a1-93f3-050570093e47', 'f53d4cd4-c71e-417d-895c-454c0fd1dffd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:38 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 Apr 07 06:15:38 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:38 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:38 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:39 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731" returned: 0 in 0.597s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:39 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.464s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:39 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731 Apr 07 06:15:39 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:39 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8f636f12-7568-4305-a5e6-9a4a2671b233 tempest-VolumesGetTest-1623778177 None] Lock "cinder-6fc509e8-754f-473e-bc8f-375840306d10-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:39 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0c0f89ce-80d2-473b-9606-115b275b4731" returned: 0 in 0.455s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-quobyte-0c0f89ce-80d2-473b-9606-115b275b4731" released by "delete_volume" :: held 1.092s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Created reservations ['f53dd8c1-096e-4cbc-9fc0-f20d50efce0a', '953fc9d2-aecf-4c89-a529-14af95f447b0', 'e5c22ffe-792b-4770-a8bf-621db1458b35', '258e1f79-09ba-451f-b667-fe3b23b59e55'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:39 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:39 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-efad03a9-d0fc-44cf-8cdd-9d5822df5b98-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "cinder-efad03a9-d0fc-44cf-8cdd-9d5822df5b98-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Acquiring lock "cinder-quobyte-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d5362-e5dd-43a2-a86e-bfa0dacbf4cf]: (4, 'raw') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:40 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:40 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:40 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.449s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Deleted volume successfully. Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f296a8d9-f010-4c73-8c14-2e2ad6623ff9 tempest-VolumesSnapshotListTestJSON-512116753 None] Lock "cinder-0c0f89ce-80d2-473b-9606-115b275b4731-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:40 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 0 in 0.493s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:40 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:40 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:41 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 1 in 0.461s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98' failed. Not Retrying. {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:41 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98 Apr 07 06:15:41 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:41 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" returned: 0 in 0.495s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "cinder-quobyte-efad03a9-d0fc-44cf-8cdd-9d5822df5b98" released by "delete_volume" :: held 1.492s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Created reservations ['4f8edefc-4cb0-4498-805c-989673aad32d', 'f4e561cc-ed74-408c-89ea-98b2f5a65f81', '9c0c75ca-526b-4aef-9ad5-5780c992bb0f', '8f1d3708-8846-40b4-b8c5-377c47c8facb'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:41 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:41 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.467s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Deleted volume successfully. Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2064bb26-a718-4243-9557-411f1924209b tempest-VolumesGetTest-1623778177 None] Lock "cinder-efad03a9-d0fc-44cf-8cdd-9d5822df5b98-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (66e2a711-b2f5-4796-811d-0f038134d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd19898-8068-4e3e-8f7e-4fae85c066f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd19898-8068-4e3e-8f7e-4fae85c066f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046775127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfea0282-545f-4101-8228-7c9d87308ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:43Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39db0d94-e851-439c-b81a-9122ea673e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39db0d94-e851-439c-b81a-9122ea673e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b668c92-df97-4fa7-a050-538549847bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b668c92-df97-4fa7-a050-538549847bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfea0282-545f-4101-8228-7c9d87308ce0', 'volume_name': 'volume-bfea0282-545f-4101-8228-7c9d87308ce0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e391b7ec-60a1-40fb-a324-d6ed0ba72b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e391b7ec-60a1-40fb-a324-d6ed0ba72b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf4e661-690b-49f2-8f6a-9a9cd0a5eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume bfea0282-545f-4101-8228-7c9d87308ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfea0282-545f-4101-8228-7c9d87308ce0', 'volume_size': 1} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046775127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfea0282-545f-4101-8228-7c9d87308ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:43Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume bfea0282-545f-4101-8228-7c9d87308ce0 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:42 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:42 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 1073741824 Apr 07 06:15:42 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:43 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 1073741824" returned: 0 in 0.534s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:43 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 Apr 07 06:15:43 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:43 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0" returned: 0 in 0.449s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf4e661-690b-49f2-8f6a-9a9cd0a5eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfea0282-545f-4101-8228-7c9d87308ce0', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6b854c-d3e4-4ee7-b69e-8fc3e65106df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:43 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-bfea0282-545f-4101-8228-7c9d87308ce0 (bfea0282-545f-4101-8228-7c9d87308ce0): created successfully Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6b854c-d3e4-4ee7-b69e-8fc3e65106df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (66e2a711-b2f5-4796-811d-0f038134d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:43 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e88e9baa-cca4-4fc8-8444-1e3dfab1fe54 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (1ef1c25a-d2c7-44e7-afef-924936458e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd0bfd2-387e-4e77-a7f5-f1639f297c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd0bfd2-387e-4e77-a7f5-f1639f297c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424997170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788715b3-19ad-4e9e-81ad-ecbccd8b2a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:45Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a765c-15da-42e9-a2d5-bf0caca46e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a765c-15da-42e9-a2d5-bf0caca46e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9576f5b2-4872-4701-8137-02205f242e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9576f5b2-4872-4701-8137-02205f242e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788715b3-19ad-4e9e-81ad-ecbccd8b2a8e', 'volume_name': 'volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b9c150-fe3d-413f-8c95-bf282d2e1461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b9c150-fe3d-413f-8c95-bf282d2e1461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1878469-171e-44c9-9697-0043737a5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume 788715b3-19ad-4e9e-81ad-ecbccd8b2a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e', 'volume_size': 1} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424997170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788715b3-19ad-4e9e-81ad-ecbccd8b2a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:45Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume 788715b3-19ad-4e9e-81ad-ecbccd8b2a8e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:45 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e 1073741824 Apr 07 06:15:45 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (5a4883d9-d654-4293-8a34-c41fe10b4449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f01742-d083-4dfb-ae44-8dbb00afebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f01742-d083-4dfb-ae44-8dbb00afebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1965555101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187b600-1b5f-4952-b5be-7ad6c69df1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:45Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d925e05-4a9e-4648-8c0b-cd4857a9e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d925e05-4a9e-4648-8c0b-cd4857a9e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c933fa7d-0737-429c-adff-8bc3b01769b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c933fa7d-0737-429c-adff-8bc3b01769b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4187b600-1b5f-4952-b5be-7ad6c69df1f7', 'volume_name': 'volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531eac68-f59b-4ae2-97af-72b080f12bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531eac68-f59b-4ae2-97af-72b080f12bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e82f394-dfa5-4d79-830c-4f38e241e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume 4187b600-1b5f-4952-b5be-7ad6c69df1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7', 'volume_size': 1} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (7663cf3c-038b-4d3a-b8d0-65b6d339f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b43f0a-566c-47df-b415-23f430cfc898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b43f0a-566c-47df-b415-23f430cfc898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239053037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657b245a-d8b8-456b-96f5-2bef90197a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ac4d67-8e32-4381-9439-5c475be94887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ac4d67-8e32-4381-9439-5c475be94887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c45091-4d65-476a-961b-7acc83546441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c45091-4d65-476a-961b-7acc83546441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657b245a-d8b8-456b-96f5-2bef90197a4f', 'volume_name': 'volume-657b245a-d8b8-456b-96f5-2bef90197a4f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe214e8f-8af9-4f6b-8110-39bd49656ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe214e8f-8af9-4f6b-8110-39bd49656ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2819f92-6ee3-4a92-9f61-96a0aa742964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume 657b245a-d8b8-456b-96f5-2bef90197a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657b245a-d8b8-456b-96f5-2bef90197a4f', 'volume_size': 1} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e 1073741824" returned: 0 in 0.627s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e Apr 07 06:15:45 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (0ca3e142-ac33-45d4-b470-54ca63ac5f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a3b060-bedf-4f1b-b69a-1230a3940a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a3b060-bedf-4f1b-b69a-1230a3940a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2035940912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c537688-2e3f-412f-9271-47f70dbf4cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294f6f65-e2d5-4787-9dd5-1efdf2cfa46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294f6f65-e2d5-4787-9dd5-1efdf2cfa46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886cb108-3f0c-4a33-a5ba-47dfcf260fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886cb108-3f0c-4a33-a5ba-47dfcf260fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c537688-2e3f-412f-9271-47f70dbf4cbb', 'volume_name': 'volume-1c537688-2e3f-412f-9271-47f70dbf4cbb', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1b3bb2-9036-4d52-a2bb-8e456bcea966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1b3bb2-9036-4d52-a2bb-8e456bcea966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc42476f-810f-43a1-b52f-d2f14874663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Volume 1c537688-2e3f-412f-9271-47f70dbf4cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c537688-2e3f-412f-9271-47f70dbf4cbb', 'volume_size': 1} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (148e6a97-a4f6-4cf2-beca-ffa149a036c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d4c055-5802-41e1-9b37-05c189494828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d4c055-5802-41e1-9b37-05c189494828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550356359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f506f43-a5ce-4382-9306-1d89f90c7905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061878ed-b5e7-4eb8-8b3a-4d1baf4daa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061878ed-b5e7-4eb8-8b3a-4d1baf4daa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fd76ba-b9b8-4078-aaec-9184553cbb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fd76ba-b9b8-4078-aaec-9184553cbb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f506f43-a5ce-4382-9306-1d89f90c7905', 'volume_name': 'volume-8f506f43-a5ce-4382-9306-1d89f90c7905', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6b9766-65b1-49fe-9479-0ef7657aeb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6b9766-65b1-49fe-9479-0ef7657aeb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25be4898-4ff4-402d-9c0f-b640d7752c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume 8f506f43-a5ce-4382-9306-1d89f90c7905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f506f43-a5ce-4382-9306-1d89f90c7905', 'volume_size': 1} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (b2c531e5-0740-4763-826d-ce7834d36a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d591c48a-e5ad-46bc-ac3a-395cc8f977ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d591c48a-e5ad-46bc-ac3a-395cc8f977ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995462452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5b23de-e12f-4c8c-9226-badf6bff95fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6ca42-f143-45a7-b5e7-ce719c1f5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6ca42-f143-45a7-b5e7-ce719c1f5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7783795-749c-4994-9e57-a054c7b4e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7783795-749c-4994-9e57-a054c7b4e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5b23de-e12f-4c8c-9226-badf6bff95fb', 'volume_name': 'volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dfecff-404d-48db-a63e-1ba9826a7fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dfecff-404d-48db-a63e-1ba9826a7fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9bbcd7-5ac1-425e-ba62-3968090b8455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume dd5b23de-e12f-4c8c-9226-badf6bff95fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb', 'volume_size': 1} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:46 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:46 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:46 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1965555101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187b600-1b5f-4952-b5be-7ad6c69df1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:45Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume 4187b600-1b5f-4952-b5be-7ad6c69df1f7 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1878469-171e-44c9-9697-0043737a5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f7cee-26e6-4c86-914e-dcf7ab9d0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 1073741824 Apr 07 06:15:46 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e (788715b3-19ad-4e9e-81ad-ecbccd8b2a8e): created successfully Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f7cee-26e6-4c86-914e-dcf7ab9d0651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (1ef1c25a-d2c7-44e7-afef-924936458e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-1b5b7ed4-375f-4d01-b984-152dd3df6444 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:46 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.414s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:46 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 1073741824" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:46 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 Apr 07 06:15:46 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:47 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7" returned: 0 in 0.435s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239053037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657b245a-d8b8-456b-96f5-2bef90197a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume 657b245a-d8b8-456b-96f5-2bef90197a4f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:47 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e82f394-dfa5-4d79-830c-4f38e241e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a99122-602e-403f-b985-52513a14ce35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:47 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f 1073741824 Apr 07 06:15:47 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:47 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 (4187b600-1b5f-4952-b5be-7ad6c69df1f7): created successfully Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a99122-602e-403f-b985-52513a14ce35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (5a4883d9-d654-4293-8a34-c41fe10b4449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:47 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-18cee3b6-7bb1-478a-9ca4-7b7dd5866ce9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:47 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f 1073741824" returned: 0 in 0.465s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:47 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f Apr 07 06:15:47 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f" returned: 0 in 0.408s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2035940912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c537688-2e3f-412f-9271-47f70dbf4cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Creating volume 1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:48 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2819f92-6ee3-4a92-9f61-96a0aa742964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657b245a-d8b8-456b-96f5-2bef90197a4f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908dbd06-7771-40b5-9aa0-a924e4b843f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:48 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb 1073741824 Apr 07 06:15:48 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-657b245a-d8b8-456b-96f5-2bef90197a4f (657b245a-d8b8-456b-96f5-2bef90197a4f): created successfully Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908dbd06-7771-40b5-9aa0-a924e4b843f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (7663cf3c-038b-4d3a-b8d0-65b6d339f81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:48 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9781dd57-3162-4451-8f6d-5bcefbb40fa8 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:48 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb 1073741824" returned: 0 in 0.476s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=193,cinder:DELETE=16,cinder:SELECT=141,cinder:INSERT=45 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=171,cinder:SELECT=146,cinder:INSERT=56,cinder:DELETE=15 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:15:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:15:48 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.410s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.062s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550356359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f506f43-a5ce-4382-9306-1d89f90c7905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume 8f506f43-a5ce-4382-9306-1d89f90c7905 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:49 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc42476f-810f-43a1-b52f-d2f14874663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c537688-2e3f-412f-9271-47f70dbf4cbb', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836b2450-abc1-4469-ac1f-a72c7ef0aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 1073741824 Apr 07 06:15:49 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Volume volume-1c537688-2e3f-412f-9271-47f70dbf4cbb (1c537688-2e3f-412f-9271-47f70dbf4cbb): created successfully Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836b2450-abc1-4469-ac1f-a72c7ef0aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (0ca3e142-ac33-45d4-b470-54ca63ac5f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:49 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-068ac396-9a1a-4ddc-b69e-ca7006f8fcfd tempest-VolumeDependencyTests-172953096 None] Created volume successfully. Apr 07 06:15:49 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 1073741824" returned: 0 in 0.485s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 Apr 07 06:15:49 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:50 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905" returned: 0 in 0.435s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.916s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995462452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5b23de-e12f-4c8c-9226-badf6bff95fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5a633c9e440deac01a28d535f8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='8e50bbda851d4b19892e805eb0543839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Creating volume dd5b23de-e12f-4c8c-9226-badf6bff95fb {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:50 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25be4898-4ff4-402d-9c0f-b640d7752c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f506f43-a5ce-4382-9306-1d89f90c7905', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c366b2-2534-4e59-a051-155169586c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb 1073741824 Apr 07 06:15:50 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:50 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-8f506f43-a5ce-4382-9306-1d89f90c7905 (8f506f43-a5ce-4382-9306-1d89f90c7905): created successfully Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c366b2-2534-4e59-a051-155169586c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (148e6a97-a4f6-4cf2-beca-ffa149a036c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9e8bb98e-1e77-4848-9b20-9b483dc0f5c0 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb 1073741824" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:50 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb Apr 07 06:15:50 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb" returned: 0 in 0.383s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.833s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Creating offline snapshot e9d72286-a1a3-4c34-8c0e-d85353fffe39 of volume 1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9bbcd7-5ac1-425e-ba62-3968090b8455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2628b-d04e-4475-b4e4-174d3bd4ddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdcb9a7-d362-4ea1-a586-04ab1a86bd45]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Volume volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb (dd5b23de-e12f-4c8c-9226-badf6bff95fb): created successfully Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2628b-d04e-4475-b4e4-174d3bd4ddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Flow 'volume_create_manager' (b2c531e5-0740-4763-826d-ce7834d36a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7c5b8f8d-2611-464c-b70d-38dc599436ea tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created volume successfully. Apr 07 06:15:51 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:15:51 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.473s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 1G Apr 07 06:15:51 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-dd5b23de-e12f-4c8c-9226-badf6bff95fb-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-dd5b23de-e12f-4c8c-9226-badf6bff95fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-dd5b23de-e12f-4c8c-9226-badf6bff95fb" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-dd5b23de-e12f-4c8c-9226-badf6bff95fb" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7b42d-07eb-49c6-ad12-75282c5de7e8]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb Apr 07 06:15:51 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 1G" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c537688-2e3f-412f-9271-47f70dbf4cbb -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c537688-2e3f-412f-9271-47f70dbf4cbb -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:15:52 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb" returned: 0 in 0.489s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb Apr 07 06:15:52 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c537688-2e3f-412f-9271-47f70dbf4cbb -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.489s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 is being set with open permissions: ugo+rw Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:15:52 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dd5b23de-e12f-4c8c-9226-badf6bff95fb" returned: 0 in 0.452s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-dd5b23de-e12f-4c8c-9226-badf6bff95fb" released by "delete_volume" :: held 0.961s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['9c15e1c7-8764-468a-b2e9-de95dc3c3489', 'c991c7f8-26b5-4bb9-b530-8821f793298a', '5a2687b4-8733-41b2-87f5-5f5985a139fd', '92ff4ee1-aa80-45f7-99c9-88f86279cb77'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:52 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info Apr 07 06:15:53 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8381df44-0ac8-48d1-8bec-c6887bac3ff9 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-dd5b23de-e12f-4c8c-9226-badf6bff95fb-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:53 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info is being set with open permissions: ugo+rw Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info Apr 07 06:15:53 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-8f506f43-a5ce-4382-9306-1d89f90c7905-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-8f506f43-a5ce-4382-9306-1d89f90c7905-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-8f506f43-a5ce-4382-9306-1d89f90c7905" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-8f506f43-a5ce-4382-9306-1d89f90c7905" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[df092a79-4c54-4176-91fb-10e206fe7034]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.info" returned: 0 in 0.453s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 Apr 07 06:15:53 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4b5b297f-8e91-431a-a72b-dc993d7fd359 tempest-VolumeDependencyTests-172953096 None] Create snapshot completed successfully Apr 07 06:15:54 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905" returned: 0 in 0.492s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905 Apr 07 06:15:54 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (de3ef9dc-b955-465b-b2f2-68ff3e992ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c084eff2-2b5d-4154-a5a9-5df8bc77c388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c084eff2-2b5d-4154-a5a9-5df8bc77c388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1358063651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e02044a-fa98-45e1-971c-78b262d1c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9d72286-a1a3-4c34-8c0e-d85353fffe39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:55Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403393e5-0ae7-43e7-9c72-5b8f488dcd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403393e5-0ae7-43e7-9c72-5b8f488dcd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2630b415-e412-42b3-9274-da1a605da427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2630b415-e412-42b3-9274-da1a605da427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e02044a-fa98-45e1-971c-78b262d1c89c', 'volume_name': 'volume-5e02044a-fa98-45e1-971c-78b262d1c89c', 'volume_size': 1, 'snapshot_id': 'e9d72286-a1a3-4c34-8c0e-d85353fffe39'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db64ea1-1a99-4c76-9161-29bea4c10ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db64ea1-1a99-4c76-9161-29bea4c10ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e8da9-69e2-40d2-b030-2fa911d6e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Volume 5e02044a-fa98-45e1-971c-78b262d1c89c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e02044a-fa98-45e1-971c-78b262d1c89c', 'volume_size': 1, 'snapshot_id': 'e9d72286-a1a3-4c34-8c0e-d85353fffe39'} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39-5e02044a-fa98-45e1-971c-78b262d1c89c" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39-5e02044a-fa98-45e1-971c-78b262d1c89c" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Creating volume 5e02044a-fa98-45e1-971c-78b262d1c89c from snapshot e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] snapshot: e9d72286-a1a3-4c34-8c0e-d85353fffe39, volume: 5e02044a-fa98-45e1-971c-78b262d1c89c, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:15:54 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-8f506f43-a5ce-4382-9306-1d89f90c7905" returned: 0 in 0.485s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[381db67b-0eb7-4a01-bdb1-4a5d12506f20]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-8f506f43-a5ce-4382-9306-1d89f90c7905" released by "delete_volume" :: held 1.013s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['3ca4db07-af49-4f14-ad58-45a9176b1851', '15f9da91-ffec-40bb-9e24-55c38abc02f3', 'e191e63e-4499-451e-b8af-0fa18c910cba', '59dc5f31-0032-4071-8a63-16af3901792b'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:54 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:15:54 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:55 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c537688-2e3f-412f-9271-47f70dbf4cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15bc693-30ca-4b1e-928d-5d4f9be7c5fb]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.434s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:55 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-f7b826f0-6936-489c-ae20-bdf06798729d tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-8f506f43-a5ce-4382-9306-1d89f90c7905-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:55 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:15:55 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.527s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:15:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c Apr 07 06:15:55 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-657b245a-d8b8-456b-96f5-2bef90197a4f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-657b245a-d8b8-456b-96f5-2bef90197a4f-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-657b245a-d8b8-456b-96f5-2bef90197a4f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-657b245a-d8b8-456b-96f5-2bef90197a4f" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b913da6-4554-456e-8490-f59753ed4b27]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:56 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f Apr 07 06:15:56 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f" returned: 0 in 1.211s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f Apr 07 06:15:57 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c" returned: 0 in 2.199s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec606ca1-3ee3-4e6c-a045-c81200b693bc]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:58 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:15:58 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-657b245a-d8b8-456b-96f5-2bef90197a4f" returned: 0 in 0.907s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-657b245a-d8b8-456b-96f5-2bef90197a4f" released by "delete_volume" :: held 2.143s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['0aaffd92-8c56-4b42-b0ff-56d27c0e9168', '4d027f3a-328b-4670-a20a-dd1611324a20', 'aa87babc-1257-4bef-9e90-06ecd7d61c2c', 'a46b757b-a816-4a45-9763-d49d734f6d31'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:58 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:15:58 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.641s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:15:58 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Converted 1024.00 MB image at 465.30 MB/s Apr 07 06:15:58 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c is being set with open permissions: ugo+rw Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:58 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c Apr 07 06:15:58 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:15:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-581d6e46-987e-47a7-80b8-3c6e92b48c03 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-657b245a-d8b8-456b-96f5-2bef90197a4f-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:59 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" released by "_copy_volume_from_snapshot" :: held 4.350s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39-5e02044a-fa98-45e1-971c-78b262d1c89c" released by "_create_volume_from_snapshot" :: held 4.372s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.382s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e8da9-69e2-40d2-b030-2fa911d6e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e02044a-fa98-45e1-971c-78b262d1c89c', 'volume_size': 1, 'snapshot_id': 'e9d72286-a1a3-4c34-8c0e-d85353fffe39'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6e73bc-2b49-4917-8dac-401deebdb2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Volume volume-5e02044a-fa98-45e1-971c-78b262d1c89c (5e02044a-fa98-45e1-971c-78b262d1c89c): created successfully Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6e73bc-2b49-4917-8dac-401deebdb2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (de3ef9dc-b955-465b-b2f2-68ff3e992ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2ba037e1-ad9f-46f2-851b-1004ec240cd4 tempest-VolumeDependencyTests-172953096 None] Created volume successfully. Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-4187b600-1b5f-4952-b5be-7ad6c69df1f7-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-4187b600-1b5f-4952-b5be-7ad6c69df1f7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-4187b600-1b5f-4952-b5be-7ad6c69df1f7" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-4187b600-1b5f-4952-b5be-7ad6c69df1f7" acquired by "delete_volume" :: waited 0.014s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15097c4c-b0d6-48d5-9320-a4eab6a2a63e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:59 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 Apr 07 06:15:59 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:59 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7" returned: 0 in 0.501s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:59 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7 Apr 07 06:15:59 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-e9d72286-a1a3-4c34-8c0e-d85353fffe39-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-e9d72286-a1a3-4c34-8c0e-d85353fffe39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Deleting offline snapshot e9d72286-a1a3-4c34-8c0e-d85353fffe39 of volume 1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] snapshot_file for this snap is: volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057deea-42fa-40a6-b332-97a8e769bb3b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:16:00 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4187b600-1b5f-4952-b5be-7ad6c69df1f7" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-4187b600-1b5f-4952-b5be-7ad6c69df1f7" released by "delete_volume" :: held 0.986s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['2edbaa32-820f-4eae-b78f-8581a2aa008e', '60a50e87-3ba9-4969-a662-7d32f2a1ca49', 'b4b824c8-180c-4863-aa2d-6f7558fa2778', 'dfe7b95c-b1e0-471d-ba68-27a248bfe31f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:00 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.521s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c537688-2e3f-412f-9271-47f70dbf4cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226ac25-798f-415d-bd24-b07aed2c68c6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:16:00 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.437s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:00 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:16:00 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4bd5291b-169d-4776-bc46-02961b52df78 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-4187b600-1b5f-4952-b5be-7ad6c69df1f7-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:01 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.507s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:16:01 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" acquired by "delete_volume" :: waited 0.023s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d03320f-fcdc-4ca1-ac3f-41459acfb161]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e Apr 07 06:16:01 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.512s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:01 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39 Apr 07 06:16:01 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb.e9d72286-a1a3-4c34-8c0e-d85353fffe39" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" returned: 0 in 0.582s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e Apr 07 06:16:02 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-e9d72286-a1a3-4c34-8c0e-d85353fffe39" released by "_delete_snapshot" :: held 2.076s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" released by "delete_snapshot" :: held 2.089s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Created reservations ['aec2f71f-1f2c-43e3-ada9-971102ff2612', '65e53b40-62a6-48dd-ad13-fafe74413a23', 'fb7bfe6e-8649-4ab4-98aa-e66ed5e09d8b', 'f99ec524-a447-475b-b3eb-56e1a67d8185'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:02 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Delete snapshot completed successfully. Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9913670c-25be-481a-9e8c-c85787a23f21 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-e9d72286-a1a3-4c34-8c0e-d85353fffe39-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:02 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" returned: 0 in 0.482s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e" released by "delete_volume" :: held 1.086s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['c2763358-7c61-451d-b2ab-83fcc965927e', '76d01035-1115-4a2d-ad4a-03781bf9318b', 'f1a9de52-3424-45c5-9652-d98ca4f8062a', '6d6bbbc2-ddd6-4e77-b91d-5dd4657ad4b3'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:02 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.417s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a349efaf-b10b-4f7a-9dcf-f4c4929c3570 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-788715b3-19ad-4e9e-81ad-ecbccd8b2a8e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-1c537688-2e3f-412f-9271-47f70dbf4cbb-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-1c537688-2e3f-412f-9271-47f70dbf4cbb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e013d8-1588-40e1-8847-53af8a749663]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:16:03 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-bfea0282-545f-4101-8228-7c9d87308ce0-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-bfea0282-545f-4101-8228-7c9d87308ce0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "cinder-quobyte-bfea0282-545f-4101-8228-7c9d87308ce0" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-bfea0282-545f-4101-8228-7c9d87308ce0" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8c857-2fb7-4107-ae75-e36f2e22a580]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.481s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb Apr 07 06:16:03 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 Apr 07 06:16:03 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0" returned: 0 in 0.469s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0 Apr 07 06:16:04 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-1c537688-2e3f-412f-9271-47f70dbf4cbb" returned: 0 in 0.458s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-1c537688-2e3f-412f-9271-47f70dbf4cbb" released by "delete_volume" :: held 0.975s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Created reservations ['23b44148-93ce-41b4-ae44-15399b80ca22', '22af11c3-f667-4f49-8be1-8392e210b59d', '1b87bad8-3947-4ebe-85e6-c00588f23afa', 'db8e7965-6011-42eb-be60-4cb8e17adce7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:04 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (515c98aa-b169-4e30-95a7-2d605c6a998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4bc92-c919-4616-a06b-305af89b023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4bc92-c919-4616-a06b-305af89b023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-762988839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13670c1-95ec-49a5-bd0c-e6e79691fe03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:05Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f13321-55ac-452b-a250-2e69f79af21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:04 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f13321-55ac-452b-a250-2e69f79af21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e08db5-25df-4bc6-92b5-71a198ca1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e08db5-25df-4bc6-92b5-71a198ca1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'volume_name': 'volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707f9fb2-1d21-4678-8628-1784a2e94b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707f9fb2-1d21-4678-8628-1784a2e94b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1b0bb7-37a1-4385-878b-b8c00e3f1313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:04 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Volume f13670c1-95ec-49a5-bd0c-e6e79691fe03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'volume_size': 1} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-762988839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13670c1-95ec-49a5-bd0c-e6e79691fe03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:05Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Creating volume f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:04 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-bfea0282-545f-4101-8228-7c9d87308ce0" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-quobyte-bfea0282-545f-4101-8228-7c9d87308ce0" released by "delete_volume" :: held 0.981s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 1073741824 Apr 07 06:16:04 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.421s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Created reservations ['329d8643-db60-47b0-9f7b-4be0b4cc8f25', 'b41fd0c6-1832-4a18-9927-1b8d3d45d966', '320ac977-68ed-4a58-b457-e5679fc862a9', '4748330e-dd12-41c5-84b7-ffa486a7a5f4'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:04 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Deleted volume successfully. Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9da02d91-22d3-4139-b370-44c80651def4 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-1c537688-2e3f-412f-9271-47f70dbf4cbb-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:04 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 1073741824" returned: 0 in 0.520s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:05 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Deleted volume successfully. Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-77fb8c0a-dae2-4e78-a5cc-c18a7a7e70c5 tempest-CreateVolumesFromSourceVolumeTest-343505034 None] Lock "cinder-bfea0282-545f-4101-8228-7c9d87308ce0-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:05 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:05 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.416s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1b0bb7-37a1-4385-878b-b8c00e3f1313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f629c-078e-4af8-a627-4b6fc974ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:05 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Volume volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 (f13670c1-95ec-49a5-bd0c-e6e79691fe03): created successfully Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f629c-078e-4af8-a627-4b6fc974ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:05 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (515c98aa-b169-4e30-95a7-2d605c6a998f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:05 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-022c7166-5a5a-4a18-9a02-cb30dc24c985 tempest-VolumeDependencyTests-172953096 None] Created volume successfully. Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (bb85c633-d2a6-461c-ac9a-83137060d9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34f792-4ba4-429b-a206-ffa76c100c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34f792-4ba4-429b-a206-ffa76c100c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-522397041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56874495-a621-4a5c-948c-b47af67d7914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d8457c4f4c4af393b79923e2b833cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f13670c1-95ec-49a5-bd0c-e6e79691fe03,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:07Z,use_quota=True,user_id='6543f7fdbd2549979c4da6dadae33e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ac92ac-17bd-465d-a258-7681358fb525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ac92ac-17bd-465d-a258-7681358fb525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebfbaa3-c063-40f9-97c2-e9bb6c5a440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebfbaa3-c063-40f9-97c2-e9bb6c5a440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '56874495-a621-4a5c-948c-b47af67d7914', 'volume_name': 'volume-56874495-a621-4a5c-948c-b47af67d7914', 'volume_size': 1, 'source_volid': 'f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae24148-b74f-45f8-8351-ae111539f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae24148-b74f-45f8-8351-ae111539f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e520461-0418-458c-9b2a-9ce4f3ac366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Volume 56874495-a621-4a5c-948c-b47af67d7914: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-56874495-a621-4a5c-948c-b47af67d7914', 'volume_size': 1, 'source_volid': 'f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'source_volstatus': 'available'} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:07 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Cloning volume f13670c1-95ec-49a5-bd0c-e6e79691fe03 to volume 56874495-a621-4a5c-948c-b47af67d7914 Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Creating offline snapshot f4560556-f298-4689-9f6e-ab138d292550 of volume f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d4962-097b-4cb2-85de-8225d69a8828]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:07 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.561s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:07 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 1G Apr 07 06:16:07 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Flow 'volume_create_manager' (10ab8855-d2ea-45c5-a528-597d14b6595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b8f680-3d60-4999-9fae-68a73333b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b8f680-3d60-4999-9fae-68a73333b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde90058-0ddd-435e-bf24-7fd52be06fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86220042dc48ba86cbd32012817eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:08Z,use_quota=True,user_id='4490bdccb74c454c9bfd0e7fa0dfc76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c79527-5629-444f-95e7-64e6521562e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c79527-5629-444f-95e7-64e6521562e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfc14f5-2254-4355-b416-a2b2590d0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfc14f5-2254-4355-b416-a2b2590d0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde90058-0ddd-435e-bf24-7fd52be06fa7', 'volume_name': 'volume-cde90058-0ddd-435e-bf24-7fd52be06fa7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a5f55-6c3a-4167-8462-7f10c7e7cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a5f55-6c3a-4167-8462-7f10c7e7cffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5fd32b-7a4c-48da-b5fb-af93038da748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:07 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Volume cde90058-0ddd-435e-bf24-7fd52be06fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde90058-0ddd-435e-bf24-7fd52be06fa7', 'volume_size': 1} Apr 07 06:16:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:08 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 1G" returned: 0 in 0.475s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:08 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 is being set with open permissions: ugo+rw Apr 07 06:16:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:08 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.398s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:09 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info Apr 07 06:16:09 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info" returned: 0 in 0.424s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info is being set with open permissions: ugo+rw Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:09 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info Apr 07 06:16:09 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.info" returned: 0 in 0.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] snapshot: f4560556-f298-4689-9f6e-ab138d292550, volume: 56874495-a621-4a5c-948c-b47af67d7914, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[98475797-6c7d-453a-9a42-ebe5e89f81de]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:10 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:10 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:10 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.476s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[885543ce-a2e2-4b66-8b9e-82f6c59dd75a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:10 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:10 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:10 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.484s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:16:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:10 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 Apr 07 06:16:10 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:12 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914" returned: 0 in 1.977s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:12 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8dc273-6fb3-4b45-8de3-a24ec77e08f4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:12 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:12 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:13 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.604s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:16:13 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Converted 1024.00 MB image at 517.55 MB/s Apr 07 06:16:13 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 is being set with open permissions: ugo+rw Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:13 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 Apr 07 06:16:13 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:13 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" released by "_copy_volume_from_snapshot" :: held 4.010s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-f4560556-f298-4689-9f6e-ab138d292550" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-f4560556-f298-4689-9f6e-ab138d292550" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Deleting offline snapshot f4560556-f298-4689-9f6e-ab138d292550 of volume f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] snapshot_file for this snap is: volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[df967d68-0c3d-4020-9aa9-1183ab747dd1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:14 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[482542d4-3559-490c-87c3-60824c903639]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:14 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.466s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:14 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.447s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550 Apr 07 06:16:15 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03.f4560556-f298-4689-9f6e-ab138d292550" returned: 0 in 0.405s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-f4560556-f298-4689-9f6e-ab138d292550" released by "_delete_snapshot" :: held 1.856s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.683s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.977s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde90058-0ddd-435e-bf24-7fd52be06fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86220042dc48ba86cbd32012817eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:08Z,use_quota=True,user_id='4490bdccb74c454c9bfd0e7fa0dfc76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Creating volume cde90058-0ddd-435e-bf24-7fd52be06fa7 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:15 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 1073741824 Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e520461-0418-458c-9b2a-9ce4f3ac366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56874495-a621-4a5c-948c-b47af67d7914', 'volume_size': 1, 'source_volid': 'f13670c1-95ec-49a5-bd0c-e6e79691fe03', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:15 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd46de2d-3379-436f-ab85-c555f5b25646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:15 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Volume volume-56874495-a621-4a5c-948c-b47af67d7914 (56874495-a621-4a5c-948c-b47af67d7914): created successfully Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd46de2d-3379-436f-ab85-c555f5b25646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Flow 'volume_create_manager' (bb85c633-d2a6-461c-ac9a-83137060d9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c86a5216-255d-4065-a9ca-1524ab9b3a79 tempest-VolumeDependencyTests-172953096 None] Created volume successfully. Apr 07 06:16:16 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 1073741824" returned: 0 in 0.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:16 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 Apr 07 06:16:16 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-f13670c1-95ec-49a5-bd0c-e6e79691fe03-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-f13670c1-95ec-49a5-bd0c-e6e79691fe03-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-f13670c1-95ec-49a5-bd0c-e6e79691fe03" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-f13670c1-95ec-49a5-bd0c-e6e79691fe03" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745ed19-1af7-4aa3-9774-795e59665500]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:16 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:16 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:16 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7" returned: 0 in 0.444s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5fd32b-7a4c-48da-b5fb-af93038da748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde90058-0ddd-435e-bf24-7fd52be06fa7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4126259-32fe-4a50-9ccc-0e25f4acdcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:16 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Volume volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 (cde90058-0ddd-435e-bf24-7fd52be06fa7): created successfully Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4126259-32fe-4a50-9ccc-0e25f4acdcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Flow 'volume_create_manager' (10ab8855-d2ea-45c5-a528-597d14b6595a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d0aac2e5-2c22-4f14-96a9-7ecd19b1bb2f tempest-CinderUnicodeTest-756967608 None] Created volume successfully. Apr 07 06:16:17 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:17 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03 Apr 07 06:16:17 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:17 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f13670c1-95ec-49a5-bd0c-e6e79691fe03" returned: 0 in 0.416s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-f13670c1-95ec-49a5-bd0c-e6e79691fe03" released by "delete_volume" :: held 0.923s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Created reservations ['32389176-00a6-4c48-84b2-3f2b5f1411b9', '29790114-81eb-436f-93a3-babb6d9a4272', '2e648b25-f57d-4d59-8b08-ac0d58197708', 'fe0b12fb-a87a-40cc-9c3e-c46e811b3f0c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:17 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:17 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Flow 'volume_create_manager' (0316e17c-edbe-43a8-9c7e-7744e799205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bb19ea-2895-496e-a755-cdd6bbb6bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-56874495-a621-4a5c-948c-b47af67d7914-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bb19ea-2895-496e-a755-cdd6bbb6bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1693217173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a255eb9d-0e8a-40d2-b859-3ab09c3f94f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86220042dc48ba86cbd32012817eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:18Z,use_quota=True,user_id='4490bdccb74c454c9bfd0e7fa0dfc76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca344695-e47f-4f33-8dcf-0270689c3cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca344695-e47f-4f33-8dcf-0270689c3cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033bd913-acdb-46fe-a78d-3936a755b360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033bd913-acdb-46fe-a78d-3936a755b360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a255eb9d-0e8a-40d2-b859-3ab09c3f94f2', 'volume_name': 'volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a57b8e-f763-436d-9257-b282a548eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a57b8e-f763-436d-9257-b282a548eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a6e41a-c9e7-4148-9e36-1b71f6dbd862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Volume a255eb9d-0e8a-40d2-b859-3ab09c3f94f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2', 'volume_size': 1} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1693217173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a255eb9d-0e8a-40d2-b859-3ab09c3f94f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86220042dc48ba86cbd32012817eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:18Z,use_quota=True,user_id='4490bdccb74c454c9bfd0e7fa0dfc76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Creating volume a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:17 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "cinder-56874495-a621-4a5c-948c-b47af67d7914-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:17 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 1073741824 Apr 07 06:16:17 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b2ece-d2c0-452e-a355-9c59f8faaab9]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:17 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 Apr 07 06:16:17 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:18 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Deleted volume successfully. Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-708936eb-f7cc-46d9-bf33-6ad423dd34f0 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-f13670c1-95ec-49a5-bd0c-e6e79691fe03-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:18 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 1073741824" returned: 0 in 0.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 Apr 07 06:16:18 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:18 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914 Apr 07 06:16:18 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:18 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" returned: 0 in 0.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a6e41a-c9e7-4148-9e36-1b71f6dbd862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6f101b-d361-476f-9c94-560a0277ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:18 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Volume volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 (a255eb9d-0e8a-40d2-b859-3ab09c3f94f2): created successfully Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6f101b-d361-476f-9c94-560a0277ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:18 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Flow 'volume_create_manager' (0316e17c-edbe-43a8-9c7e-7744e799205c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56874495-a621-4a5c-948c-b47af67d7914" returned: 0 in 0.428s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-56874495-a621-4a5c-948c-b47af67d7914" released by "delete_volume" :: held 0.909s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-64732bde-7077-4b69-bb87-b4ce4714f1f6 tempest-CinderUnicodeTest-756967608 None] Created volume successfully. Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Created reservations ['32fa4e4c-14d4-4cd3-b2d0-60b5f20c8532', 'ec9aa71e-17d1-4e9d-9b9d-1bd716b90707', '12b2913e-3089-49bb-b2be-0ac4b58079ba', 'ddffef0f-1c00-4162-9321-162e5759fb7a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:18 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:19 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.402s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:19 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Deleted volume successfully. Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-128cbb79-3a1c-4438-9460-814317bdf08d tempest-VolumeDependencyTests-172953096 None] Lock "cinder-56874495-a621-4a5c-948c-b47af67d7914-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-5e02044a-fa98-45e1-971c-78b262d1c89c-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-5e02044a-fa98-45e1-971c-78b262d1c89c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ac55c-8090-414b-9f6e-45c8828c706b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Creating offline snapshot 6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 of volume a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d46e83-a3b2-4ac5-9d30-ab457b0d6bce]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c Apr 07 06:16:20 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 Apr 07 06:16:20 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c Apr 07 06:16:20 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" returned: 0 in 0.469s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 1G Apr 07 06:16:20 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-5e02044a-fa98-45e1-971c-78b262d1c89c" returned: 0 in 0.402s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-quobyte-5e02044a-fa98-45e1-971c-78b262d1c89c" released by "delete_volume" :: held 0.888s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Created reservations ['87d15d85-dee7-4a82-9fee-77b3f515c57a', 'ba9f6be0-71ce-45ae-97aa-165c40a5e12c', '9aa7ef83-4442-4140-ba3f-63f7ae1ccf0c', 'c6fa71fc-4936-43db-8515-941de5697cc5'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:20 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:21 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 1G" returned: 0 in 0.542s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:21 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 Apr 07 06:16:21 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:21 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.440s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:21 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Deleted volume successfully. Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-998447e4-f757-4eea-8f1f-62a6cb07ed40 tempest-VolumeDependencyTests-172953096 None] Lock "cinder-5e02044a-fa98-45e1-971c-78b262d1c89c-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:21 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 is being set with open permissions: ugo+rw Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:21 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 Apr 07 06:16:21 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:21 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" returned: 0 in 0.455s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:22 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info Apr 07 06:16:22 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:22 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info" returned: 0 in 0.394s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:22 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info is being set with open permissions: ugo+rw Apr 07 06:16:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:22 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info Apr 07 06:16:22 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:22 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.info" returned: 0 in 0.398s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-21571a04-cfbe-4028-9e3c-3950ab76059b tempest-CinderUnicodeTest-756967608 None] Create snapshot completed successfully Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-quobyte-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Deleting offline snapshot 6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 of volume a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] snapshot_file for this snap is: volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178f63b-e6df-4fbc-98b2-0165fbbaf870]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:23 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 Apr 07 06:16:23 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:23 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" returned: 0 in 0.465s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e694095-411b-463a-a7da-936e269bcc35]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:23 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 Apr 07 06:16:23 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:24 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" returned: 0 in 0.446s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:24 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 Apr 07 06:16:24 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:24 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" returned: 0 in 0.428s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:24 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284 Apr 07 06:16:24 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:24 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2.6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" returned: 0 in 0.391s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284" released by "_delete_snapshot" :: held 1.785s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" released by "delete_snapshot" :: held 1.798s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Created reservations ['554852f0-1f0a-40ef-8b78-1df526516f03', '19f66f05-127a-40de-91e8-6941d0322ec0', '94a60e64-e028-426a-920c-582a2744bf21', '7f73ac65-2b7b-43f8-b29d-15354fd416a8'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:24 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Delete snapshot completed successfully. Apr 07 06:16:24 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bbc7a700-6d6a-40ee-b316-9539d2b325e1 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-6f289e62-8d6a-4bc6-9eb0-ea50ec4ec284-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "cinder-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c231fbc-31fd-44b1-a205-7c47856fb1e5]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:25 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 Apr 07 06:16:25 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:25 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" returned: 0 in 0.460s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:25 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2 Apr 07 06:16:25 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:26 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" returned: 0 in 0.408s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2" released by "delete_volume" :: held 0.905s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Created reservations ['0560905c-a2e5-4555-a9ca-e14b9157a9ca', '430e2a49-8c85-40ec-90d5-8ce67fd234a1', '9b2388cd-a1d1-4ca2-83e5-1078c581a6cf', '99aeae9a-04fe-4313-adc5-2ff7c50355e4'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:26 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:26 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-cde90058-0ddd-435e-bf24-7fd52be06fa7-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-cde90058-0ddd-435e-bf24-7fd52be06fa7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "cinder-quobyte-cde90058-0ddd-435e-bf24-7fd52be06fa7" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-cde90058-0ddd-435e-bf24-7fd52be06fa7" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0285042-38fb-4b79-aeed-8b618617921f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:26 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 Apr 07 06:16:26 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:26 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.429s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:26 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Deleted volume successfully. Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-79efdc68-bbdc-497b-b0ba-ca3ba043197f tempest-CinderUnicodeTest-756967608 None] Lock "cinder-a255eb9d-0e8a-40d2-b859-3ab09c3f94f2-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:26 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7" returned: 0 in 0.452s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:26 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7 Apr 07 06:16:26 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:27 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-cde90058-0ddd-435e-bf24-7fd52be06fa7" returned: 0 in 0.389s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-quobyte-cde90058-0ddd-435e-bf24-7fd52be06fa7" released by "delete_volume" :: held 0.862s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Created reservations ['e768c069-e514-4f22-a91e-5af9f1cb5b5c', 'ed1fba8d-dc57-4f32-8df4-4798dec2ba8a', 'ee5ed502-d1e7-40c7-995b-fdb2af821726', '4c4fcc21-55d1-4edd-8c70-f3706c41f66f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:27 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:27 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:27 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.449s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:27 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Deleted volume successfully. Apr 07 06:16:27 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-30e281dc-b184-41ca-883e-77104bf0ee02 tempest-CinderUnicodeTest-756967608 None] Lock "cinder-cde90058-0ddd-435e-bf24-7fd52be06fa7-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:37 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=135,cinder:SELECT=96,cinder:INSERT=37,cinder:DELETE=9 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:16:37 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=92,cinder:INSERT=30,cinder:UPDATE=130,cinder:DELETE=13 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Flow 'volume_create_manager' (bd7eda76-924e-4819-8ffe-9fb79722dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2db519f-244a-470e-9f1e-ad761bde4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2db519f-244a-470e-9f1e-ad761bde4be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1266343296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5dbdf56-11f2-414e-8e28-1917336889b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a56ebabde54803b347a3a977e5dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:43Z,use_quota=True,user_id='08e53f1a7e6946fa93638b177e29a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a880e0a-6d27-4ec8-afc5-50b89b569f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a880e0a-6d27-4ec8-afc5-50b89b569f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559d157-9b73-482b-aa0e-75dd81a0165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559d157-9b73-482b-aa0e-75dd81a0165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5dbdf56-11f2-414e-8e28-1917336889b5', 'volume_name': 'volume-a5dbdf56-11f2-414e-8e28-1917336889b5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56bd3b6-e51a-49b5-98ff-40b3c4c8a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56bd3b6-e51a-49b5-98ff-40b3c4c8a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12086947-fee5-4590-b2c3-488fdc864557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Volume a5dbdf56-11f2-414e-8e28-1917336889b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5dbdf56-11f2-414e-8e28-1917336889b5', 'volume_size': 1} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1266343296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5dbdf56-11f2-414e-8e28-1917336889b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a56ebabde54803b347a3a977e5dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:43Z,use_quota=True,user_id='08e53f1a7e6946fa93638b177e29a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Creating volume a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:42 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:16:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:42 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 1073741824 Apr 07 06:16:42 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:43 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 1073741824" returned: 0 in 0.501s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:43 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:43 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:43 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.415s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12086947-fee5-4590-b2c3-488fdc864557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5dbdf56-11f2-414e-8e28-1917336889b5', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e90581a-b3b0-4b89-8dbe-13488ad99538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:43 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Volume volume-a5dbdf56-11f2-414e-8e28-1917336889b5 (a5dbdf56-11f2-414e-8e28-1917336889b5): created successfully Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e90581a-b3b0-4b89-8dbe-13488ad99538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Flow 'volume_create_manager' (bd7eda76-924e-4819-8ffe-9fb79722dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:43 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f81eb143-4a01-4d27-971f-28195ecd4b35 tempest-SnapshotDependencyTests-112851696 None] Created volume successfully. Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Creating offline snapshot a087ccad-85ce-4aea-a237-7e8ae720dc24 of volume a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a1154d-d4ba-498f-b558-72b8a6cd906d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:45 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:45 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:45 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.447s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:45 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 1G Apr 07 06:16:45 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:45 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 1G" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5dbdf56-11f2-414e-8e28-1917336889b5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:45 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5dbdf56-11f2-414e-8e28-1917336889b5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:45 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:46 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5dbdf56-11f2-414e-8e28-1917336889b5 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.434s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:46 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 is being set with open permissions: ugo+rw Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:46 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:46 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:46 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:46 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:46 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.397s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:46 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.404s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:46 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info Apr 07 06:16:46 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:47 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info" returned: 0 in 0.410s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:47 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info is being set with open permissions: ugo+rw Apr 07 06:16:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:47 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info Apr 07 06:16:47 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:47 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.info" returned: 0 in 0.405s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:47 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-16fb8012-9a5d-48df-aab1-84276285ab36 tempest-SnapshotDependencyTests-112851696 None] Create snapshot completed successfully Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Flow 'volume_create_manager' (3e20bb10-a27e-42fb-b23a-eb2bd7cd546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab71ec3-666e-4ce0-81be-a14540855e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab71ec3-666e-4ce0-81be-a14540855e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f163b5-58f4-49d0-b51b-e051fa2051d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a56ebabde54803b347a3a977e5dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a087ccad-85ce-4aea-a237-7e8ae720dc24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:48Z,use_quota=True,user_id='08e53f1a7e6946fa93638b177e29a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f6f1-01b1-4dc7-a223-078688699dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f6f1-01b1-4dc7-a223-078688699dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8807d26-8dc1-4b08-814e-66f6999c8c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8807d26-8dc1-4b08-814e-66f6999c8c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75f163b5-58f4-49d0-b51b-e051fa2051d7', 'volume_name': 'volume-75f163b5-58f4-49d0-b51b-e051fa2051d7', 'volume_size': 1, 'snapshot_id': 'a087ccad-85ce-4aea-a237-7e8ae720dc24'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e4cd9-486b-46c7-a4d3-f2a3d8c059c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e4cd9-486b-46c7-a4d3-f2a3d8c059c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246fd3fa-acaf-42b0-b030-438fd67f1ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:48 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Volume 75f163b5-58f4-49d0-b51b-e051fa2051d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75f163b5-58f4-49d0-b51b-e051fa2051d7', 'volume_size': 1, 'snapshot_id': 'a087ccad-85ce-4aea-a237-7e8ae720dc24'} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24-75f163b5-58f4-49d0-b51b-e051fa2051d7" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24-75f163b5-58f4-49d0-b51b-e051fa2051d7" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Creating volume 75f163b5-58f4-49d0-b51b-e051fa2051d7 from snapshot a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] snapshot: a087ccad-85ce-4aea-a237-7e8ae720dc24, volume: 75f163b5-58f4-49d0-b51b-e051fa2051d7, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64da3e7-5d02-4066-b86a-3fccbd060c3a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:48 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:48 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:48 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.452s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5dbdf56-11f2-414e-8e28-1917336889b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:16:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:16:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20cb03-7767-4b22-8f5e-8b3d3dc895f4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:49 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:49 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:49 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.469s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:49 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:16:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:49 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 Apr 07 06:16:49 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:51 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7" returned: 0 in 2.012s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958d30b-e156-4706-b717-0839a55d7bed]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:51 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:51 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:52 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.580s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:16:52 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Converted 1024.00 MB image at 508.54 MB/s Apr 07 06:16:52 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 is being set with open permissions: ugo+rw Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:52 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 Apr 07 06:16:52 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:52 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7" returned: 0 in 0.408s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" released by "_copy_volume_from_snapshot" :: held 3.977s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24-75f163b5-58f4-49d0-b51b-e051fa2051d7" released by "_create_volume_from_snapshot" :: held 3.994s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246fd3fa-acaf-42b0-b030-438fd67f1ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f163b5-58f4-49d0-b51b-e051fa2051d7', 'volume_size': 1, 'snapshot_id': 'a087ccad-85ce-4aea-a237-7e8ae720dc24'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95241fb-040d-4b9e-af93-d542ce8af3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:52 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Volume volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 (75f163b5-58f4-49d0-b51b-e051fa2051d7): created successfully Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95241fb-040d-4b9e-af93-d542ce8af3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Flow 'volume_create_manager' (3e20bb10-a27e-42fb-b23a-eb2bd7cd546e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-314b9236-dcd3-411f-abb7-d9f95690554f tempest-SnapshotDependencyTests-112851696 None] Created volume successfully. Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-a087ccad-85ce-4aea-a237-7e8ae720dc24-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-a087ccad-85ce-4aea-a237-7e8ae720dc24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Deleting offline snapshot a087ccad-85ce-4aea-a237-7e8ae720dc24 of volume a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] snapshot_file for this snap is: volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa47728-4818-40fe-9a84-3f2064e38bbb]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:52 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:52 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:53 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.441s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5dbdf56-11f2-414e-8e28-1917336889b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[086621d5-fe16-424d-8cac-d6c2e2692336]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:53 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:53 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:53 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.462s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:53 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:53 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:54 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.424s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:54 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24 Apr 07 06:16:54 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:54 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5.a087ccad-85ce-4aea-a237-7e8ae720dc24" returned: 0 in 0.392s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a087ccad-85ce-4aea-a237-7e8ae720dc24" released by "_delete_snapshot" :: held 1.779s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" released by "delete_snapshot" :: held 1.789s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Created reservations ['51d1bc75-3a27-44bf-81d7-45cf4ac36658', '4c98b11e-dd63-403f-adbc-428466d25edd', 'c7148d0d-8293-4b0d-9101-267bcc07cc7b', '781c6eb8-80fd-44b7-ae62-5b7824ce4dba'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Delete snapshot completed successfully. Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a1a9b283-03de-4d3b-9004-22a3c74dc125 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-a087ccad-85ce-4aea-a237-7e8ae720dc24-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-a5dbdf56-11f2-414e-8e28-1917336889b5-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-a5dbdf56-11f2-414e-8e28-1917336889b5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e8df9-2277-44ad-8db6-b6c08b78884d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:54 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:54 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:55 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.442s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:55 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5 Apr 07 06:16:55 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:55 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a5dbdf56-11f2-414e-8e28-1917336889b5" returned: 0 in 0.384s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-a5dbdf56-11f2-414e-8e28-1917336889b5" released by "delete_volume" :: held 0.867s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Created reservations ['5dde1536-1e77-4e47-a067-5a4a4d3e7253', '8fc399b1-947d-4aef-afbb-c5b4c5eb769b', '2a8458e3-91ed-4da2-b264-f613f087beef', '8062e6bb-3aee-4687-83c1-cae356185b9c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:55 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:55 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-75f163b5-58f4-49d0-b51b-e051fa2051d7-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-75f163b5-58f4-49d0-b51b-e051fa2051d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3d64d-cd11-4ea4-bb9c-e85960f9dfda]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:56 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 Apr 07 06:16:56 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:56 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.428s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Deleted volume successfully. Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-80258e6f-5704-42bb-a065-83c3c72a73cd tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-a5dbdf56-11f2-414e-8e28-1917336889b5-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:56 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:56 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7 Apr 07 06:16:56 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:56 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-75f163b5-58f4-49d0-b51b-e051fa2051d7" returned: 0 in 0.377s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-quobyte-75f163b5-58f4-49d0-b51b-e051fa2051d7" released by "delete_volume" :: held 0.867s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Created reservations ['58f14901-3f9b-4162-9e9f-c4562fcd139b', 'e48aed5f-97e3-4e78-a7a2-26253259f394', 'fa7c9c0c-abf4-4ec4-ba33-d04503df7606', '613fef93-bd7d-41e3-99da-3ba61446b988'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:56 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:16:56 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:57 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.428s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:57 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:57 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Deleted volume successfully. Apr 07 06:16:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-83566293-b8c3-46ed-8cd8-3b3420b6ee76 tempest-SnapshotDependencyTests-112851696 None] Lock "cinder-75f163b5-58f4-49d0-b51b-e051fa2051d7-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:06 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:17:07 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=10 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:17:08 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Flow 'volume_create_manager' (a0bcba15-0181-43db-8319-5a4f5cfb2f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:08 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35f7fa1-b751-4c63-8685-b5b5922c279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35f7fa1-b751-4c63-8685-b5b5922c279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e132b-19bc-4f63-8dde-347ebbe0e6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a26927cd2743dcab98e22483dcd4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='e1cfcd6bb4bd43279159d6dc13a1eb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d8cef4-953a-4b5d-bc85-93a9a1a65594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d8cef4-953a-4b5d-bc85-93a9a1a65594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3c988-38ef-4083-8afe-eb279df83ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3c988-38ef-4083-8afe-eb279df83ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98e132b-19bc-4f63-8dde-347ebbe0e6d6', 'volume_name': 'volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f694247-233d-42e2-8917-ff3618528cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f694247-233d-42e2-8917-ff3618528cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c079080-4a52-407b-bad2-49cd3e613bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Volume b98e132b-19bc-4f63-8dde-347ebbe0e6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e132b-19bc-4f63-8dde-347ebbe0e6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a26927cd2743dcab98e22483dcd4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='e1cfcd6bb4bd43279159d6dc13a1eb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Creating volume b98e132b-19bc-4f63-8dde-347ebbe0e6d6 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:09 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 1073741824 Apr 07 06:17:09 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (4fe24539-afa8-4f02-98b6-4a912d73cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1926ab05-92a1-48f9-b8c6-787393c1152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1926ab05-92a1-48f9-b8c6-787393c1152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-204224682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1bd977-27d2-412b-ae94-c9f450b1b736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c04ee8-2f71-40c8-87ce-37cdab0a751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c04ee8-2f71-40c8-87ce-37cdab0a751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13d37cc-cc80-4cbb-b832-8d9a56740b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13d37cc-cc80-4cbb-b832-8d9a56740b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1bd977-27d2-412b-ae94-c9f450b1b736', 'volume_name': 'volume-dc1bd977-27d2-412b-ae94-c9f450b1b736', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d3d6-b7f4-45a9-b564-5d3678137f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d3d6-b7f4-45a9-b564-5d3678137f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b403ebe1-ffed-4ab9-8cbe-036ce29c52b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Volume dc1bd977-27d2-412b-ae94-c9f450b1b736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1bd977-27d2-412b-ae94-c9f450b1b736', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (41dc3ab9-7352-4f19-8dcf-fbf809160dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89755a96-abc0-472b-ae6d-64175755d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89755a96-abc0-472b-ae6d-64175755d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700102439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0052fb1-656d-4cd4-b30f-e6eb8b46373d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55e53f0-47b8-4669-abec-1871d2ce89dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55e53f0-47b8-4669-abec-1871d2ce89dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dfe9c3-2b96-4412-9973-6466c4668672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dfe9c3-2b96-4412-9973-6466c4668672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0052fb1-656d-4cd4-b30f-e6eb8b46373d', 'volume_name': 'volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2d090-9086-490a-a15f-5a07651de412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2d090-9086-490a-a15f-5a07651de412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696d8fb-79fa-4d48-beb7-8054e9dea04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Volume a0052fb1-656d-4cd4-b30f-e6eb8b46373d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (e1452c3e-2d97-4781-9ce3-e2cfa436fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5634f58d-6ce7-4eaa-88c3-939031836e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5634f58d-6ce7-4eaa-88c3-939031836e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631074049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800c2db-7d9d-4fbf-9cf2-d4fc65f34383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1e757-df16-40a8-afdf-99c92dcea6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1e757-df16-40a8-afdf-99c92dcea6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7a9104-54c9-4129-bcbe-44e35320d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7a9104-54c9-4129-bcbe-44e35320d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6800c2db-7d9d-4fbf-9cf2-d4fc65f34383', 'volume_name': 'volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0a98bc-9034-4b12-bb8f-d7b29c4bbaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0a98bc-9034-4b12-bb8f-d7b29c4bbaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847ca99-7d70-4edd-8af6-b4ecfc32967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Volume 6800c2db-7d9d-4fbf-9cf2-d4fc65f34383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 1073741824" returned: 0 in 0.515s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:09 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 Apr 07 06:17:09 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (546801d5-e406-4f1a-96ea-f03cff58df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f8c2fb-bced-47a5-be5e-4b39201a63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f8c2fb-bced-47a5-be5e-4b39201a63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-643061061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ded53e-dc21-4840-b3d9-26bf0062f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ded53e-dc21-4840-b3d9-26bf0062f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb8d31c-5133-4f23-bbf3-0882ec58b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb8d31c-5133-4f23-bbf3-0882ec58b909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961', 'volume_name': 'volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c85448-8a71-4f01-9309-a9baf73f87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c85448-8a71-4f01-9309-a9baf73f87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a7aaec-6734-4d28-b069-a880eb7cc7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Volume 6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (9e3dfb09-afb8-4748-8799-112e45442e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd64cee9-e1c8-4554-a508-61d3501c0dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd64cee9-e1c8-4554-a508-61d3501c0dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651953757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b4e231-fdab-4985-bb5c-f928476e4f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195da4f-75b0-45c8-978f-08d466a665c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195da4f-75b0-45c8-978f-08d466a665c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598b9e37-dc15-4d93-86e5-e38db829b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598b9e37-dc15-4d93-86e5-e38db829b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b4e231-fdab-4985-bb5c-f928476e4f70', 'volume_name': 'volume-f2b4e231-fdab-4985-bb5c-f928476e4f70', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4cc890-8eb5-42c3-aa10-e3baed83ece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4cc890-8eb5-42c3-aa10-e3baed83ece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5789ed97-d518-4eec-8adb-c7838dfb09ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Volume f2b4e231-fdab-4985-bb5c-f928476e4f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b4e231-fdab-4985-bb5c-f928476e4f70', 'volume_size': 1} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" returned: 0 in 0.398s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-204224682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1bd977-27d2-412b-ae94-c9f450b1b736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Creating volume dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:09 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c079080-4a52-407b-bad2-49cd3e613bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 1073741824 Apr 07 06:17:10 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f8daa-7e31-42ce-9750-26f174c2d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Volume volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 (b98e132b-19bc-4f63-8dde-347ebbe0e6d6): created successfully Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f8daa-7e31-42ce-9750-26f174c2d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Flow 'volume_create_manager' (a0bcba15-0181-43db-8319-5a4f5cfb2f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4acc8793-1ba1-4ee6-82a5-de3904b273ff tempest-CinderUnicodeTest-869163734 None] Created volume successfully. Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (cb2fb731-1650-498e-9a9d-4e9e6093fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380867ba-b597-4d40-8216-089ca521ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380867ba-b597-4d40-8216-089ca521ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641403324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4832eb47-388a-431d-a905-dd6c6f0960ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3224d0-431d-4887-a664-906039ae7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3224d0-431d-4887-a664-906039ae7018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178e7a5e-db0b-4c97-a937-76ced2d1b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178e7a5e-db0b-4c97-a937-76ced2d1b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4832eb47-388a-431d-a905-dd6c6f0960ef', 'volume_name': 'volume-4832eb47-388a-431d-a905-dd6c6f0960ef', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7244839-bf6d-4b73-b2e6-0290e04eb22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7244839-bf6d-4b73-b2e6-0290e04eb22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efa64e-e1d6-4545-b910-ed3f5fd1319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Volume 4832eb47-388a-431d-a905-dd6c6f0960ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4832eb47-388a-431d-a905-dd6c6f0960ef', 'volume_size': 1} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (347015da-e356-48c4-8fd5-d61677bd0831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91246e9b-09bf-4b15-9c91-c3f019d4cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91246e9b-09bf-4b15-9c91-c3f019d4cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410521221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95325fdd-62bc-48dd-8edf-523aac00441f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deeef39e-8119-4b32-a57a-7abe5993d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deeef39e-8119-4b32-a57a-7abe5993d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a42e86-0f9e-4b39-9506-b9c5ece08469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a42e86-0f9e-4b39-9506-b9c5ece08469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95325fdd-62bc-48dd-8edf-523aac00441f', 'volume_name': 'volume-95325fdd-62bc-48dd-8edf-523aac00441f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bafc5d-a603-4950-84b9-50bbd917e82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bafc5d-a603-4950-84b9-50bbd917e82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58db05-9316-4cb4-a371-5946722b99bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume 95325fdd-62bc-48dd-8edf-523aac00441f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95325fdd-62bc-48dd-8edf-523aac00441f', 'volume_size': 1} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Flow 'volume_create_manager' (c5e29029-a5bf-4f94-a3a9-d500922e6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8573a33e-6368-482a-9347-5da5f5eb812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8573a33e-6368-482a-9347-5da5f5eb812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1746946708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c114ec-2731-4396-929a-6b525686f7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a26927cd2743dcab98e22483dcd4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='e1cfcd6bb4bd43279159d6dc13a1eb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf53889-d974-4c77-8ac2-c4318fccf637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf53889-d974-4c77-8ac2-c4318fccf637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522ca8d0-7705-480c-93c4-0ef18820487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522ca8d0-7705-480c-93c4-0ef18820487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c114ec-2731-4396-929a-6b525686f7e8', 'volume_name': 'volume-56c114ec-2731-4396-929a-6b525686f7e8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2232bf24-ed3e-43bd-bb2b-3671dab161d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2232bf24-ed3e-43bd-bb2b-3671dab161d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2526715-7918-49d7-8555-dc8ecdc17625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Volume 56c114ec-2731-4396-929a-6b525686f7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c114ec-2731-4396-929a-6b525686f7e8', 'volume_size': 1} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:10 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 1073741824" returned: 0 in 0.584s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:10 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:10 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:10 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.374s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700102439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0052fb1-656d-4cd4-b30f-e6eb8b46373d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Creating volume a0052fb1-656d-4cd4-b30f-e6eb8b46373d {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:10 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:10 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b403ebe1-ffed-4ab9-8cbe-036ce29c52b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1bd977-27d2-412b-ae94-c9f450b1b736', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c6466d-1e4d-4a3e-9f83-9d793e34406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:11 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d 1073741824 Apr 07 06:17:11 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Volume volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 (dc1bd977-27d2-412b-ae94-c9f450b1b736): created successfully Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c6466d-1e4d-4a3e-9f83-9d793e34406a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (4fe24539-afa8-4f02-98b6-4a912d73cb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:11 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0019039c-000a-4af9-b9d6-44341aef04bd tempest-VolumeDependencyTests-1738738937 None] Created volume successfully. Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:11 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d 1073741824" returned: 0 in 0.498s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:11 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d Apr 07 06:17:11 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:11 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" returned: 0 in 0.409s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.419s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631074049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800c2db-7d9d-4fbf-9cf2-d4fc65f34383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:09Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Creating volume 6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:11 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:11 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 1073741824 Apr 07 06:17:11 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696d8fb-79fa-4d48-beb7-8054e9dea04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1f4009-deaf-44df-828e-f87ca3a92ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:11 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Volume volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d (a0052fb1-656d-4cd4-b30f-e6eb8b46373d): created successfully Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1f4009-deaf-44df-828e-f87ca3a92ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:11 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (41dc3ab9-7352-4f19-8dcf-fbf809160dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:11 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-07b05180-5f29-40b3-88a6-7e5da1801428 tempest-CreateVolumesFromImageTest-1602027023 None] Created volume successfully. Apr 07 06:17:12 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 1073741824" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:12 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 Apr 07 06:17:12 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:12 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" returned: 0 in 0.390s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-643061061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Creating volume 6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:12 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847ca99-7d70-4edd-8af6-b4ecfc32967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:12 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 1073741824 Apr 07 06:17:12 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0b2af-7888-4e5c-b1cc-e4e9e7b21657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:12 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Volume volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 (6800c2db-7d9d-4fbf-9cf2-d4fc65f34383): created successfully Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0b2af-7888-4e5c-b1cc-e4e9e7b21657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:12 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (e1452c3e-2d97-4781-9ce3-e2cfa436fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:12 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-93a0cef7-4996-4442-ade7-2b5540761324 tempest-CreateVolumesFromImageTest-1602027023 None] Created volume successfully. Apr 07 06:17:13 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 1073741824" returned: 0 in 0.476s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:13 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 Apr 07 06:17:13 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:13 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" returned: 0 in 0.403s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.795s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651953757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b4e231-fdab-4985-bb5c-f928476e4f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Creating volume f2b4e231-fdab-4985-bb5c-f928476e4f70 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:13 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a7aaec-6734-4d28-b069-a880eb7cc7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cea539-bdae-451b-8ed7-670292b8988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:13 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 1073741824 Apr 07 06:17:13 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:13 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Volume volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 (6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961): created successfully Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cea539-bdae-451b-8ed7-670292b8988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:13 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (546801d5-e406-4f1a-96ea-f03cff58df49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:13 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d1168e53-b9f4-47f3-bfe6-cfb61c614b7f tempest-CreateVolumesFromImageTest-1602027023 None] Created volume successfully. Apr 07 06:17:14 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 1073741824" returned: 0 in 0.459s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:14 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 Apr 07 06:17:14 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:14 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70" returned: 0 in 0.392s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.440s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641403324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4832eb47-388a-431d-a905-dd6c6f0960ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67935829b83f4086b279c5dd77fb1b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='a20a640edf0a41678b2b4e5484355da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Creating volume 4832eb47-388a-431d-a905-dd6c6f0960ef {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:14 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5789ed97-d518-4eec-8adb-c7838dfb09ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b4e231-fdab-4985-bb5c-f928476e4f70', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:14 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef 1073741824 Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf6df69-dae4-4efe-9c74-1cd3f3de0087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:14 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:14 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Volume volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 (f2b4e231-fdab-4985-bb5c-f928476e4f70): created successfully Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf6df69-dae4-4efe-9c74-1cd3f3de0087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:14 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (9e3dfb09-afb8-4748-8799-112e45442e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:14 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9edf91f7-f256-4e5a-87d2-04b10075f2c1 tempest-CreateVolumesFromImageTest-1602027023 None] Created volume successfully. Apr 07 06:17:15 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef 1073741824" returned: 0 in 0.454s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:15 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef Apr 07 06:17:15 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:15 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef" returned: 0 in 0.389s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.158s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410521221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95325fdd-62bc-48dd-8edf-523aac00441f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume 95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:15 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efa64e-e1d6-4545-b910-ed3f5fd1319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4832eb47-388a-431d-a905-dd6c6f0960ef', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:15 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f 1073741824 Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162cc98c-bd9e-4090-a89c-e7f4c7408ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:15 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:15 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Volume volume-4832eb47-388a-431d-a905-dd6c6f0960ef (4832eb47-388a-431d-a905-dd6c6f0960ef): created successfully Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162cc98c-bd9e-4090-a89c-e7f4c7408ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Flow 'volume_create_manager' (cb2fb731-1650-498e-9a9d-4e9e6093fe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:15 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-51bf40db-3929-4fd1-9951-9adddba47d7d tempest-CreateVolumesFromImageTest-1602027023 None] Created volume successfully. Apr 07 06:17:15 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f 1073741824" returned: 0 in 0.468s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:15 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:15 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f Apr 07 06:17:15 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:16 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f" returned: 0 in 0.379s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.765s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1746946708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c114ec-2731-4396-929a-6b525686f7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a26927cd2743dcab98e22483dcd4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:10Z,use_quota=True,user_id='e1cfcd6bb4bd43279159d6dc13a1eb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Creating volume 56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:16 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58db05-9316-4cb4-a371-5946722b99bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95325fdd-62bc-48dd-8edf-523aac00441f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5615f6ea-7bf1-461b-990b-6a2db469c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:16 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 1073741824 Apr 07 06:17:16 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:16 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-95325fdd-62bc-48dd-8edf-523aac00441f (95325fdd-62bc-48dd-8edf-523aac00441f): created successfully Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5615f6ea-7bf1-461b-990b-6a2db469c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (347015da-e356-48c4-8fd5-d61677bd0831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:16 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-da015fab-5c3c-4ee6-982b-bde208b11015 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-4832eb47-388a-431d-a905-dd6c6f0960ef-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-4832eb47-388a-431d-a905-dd6c6f0960ef-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-quobyte-4832eb47-388a-431d-a905-dd6c6f0960ef" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-4832eb47-388a-431d-a905-dd6c6f0960ef" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2a9bcb-3bd6-44c0-8eb7-ea3961c73ba1]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:16 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef Apr 07 06:17:16 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:16 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 1073741824" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:16 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:16 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 Apr 07 06:17:16 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:17 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:17 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef Apr 07 06:17:17 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:17 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8" returned: 0 in 0.393s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.800s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2526715-7918-49d7-8555-dc8ecdc17625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c114ec-2731-4396-929a-6b525686f7e8', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f16676-6312-4d12-b9ff-5e1cbcd6fe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Creating offline snapshot 5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 of volume dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1086ed34-cc66-4ee6-ac14-7af1184767c7]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:17 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Volume volume-56c114ec-2731-4396-929a-6b525686f7e8 (56c114ec-2731-4396-929a-6b525686f7e8): created successfully Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f16676-6312-4d12-b9ff-5e1cbcd6fe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Flow 'volume_create_manager' (c5e29029-a5bf-4f94-a3a9-d500922e6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:17 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-38a81c9c-5021-47b2-b8ef-5f36e1792844 tempest-CinderUnicodeTest-869163734 None] Created volume successfully. Apr 07 06:17:17 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:17 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:17 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-4832eb47-388a-431d-a905-dd6c6f0960ef" returned: 0 in 0.401s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-4832eb47-388a-431d-a905-dd6c6f0960ef" released by "delete_volume" :: held 0.922s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Created reservations ['040eff1d-898e-4ce5-9b92-75e1b50969af', '36607a16-1c31-4bcb-982b-7a2cdcfef8a4', 'c5ece1f9-310b-4b1e-9537-cec489bb3ae1', '93b505e8-38a5-4526-b15f-9153d28c5677'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:17 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:17 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-f2b4e231-fdab-4985-bb5c-f928476e4f70-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-f2b4e231-fdab-4985-bb5c-f928476e4f70-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-quobyte-f2b4e231-fdab-4985-bb5c-f928476e4f70" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-f2b4e231-fdab-4985-bb5c-f928476e4f70" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e536d-8401-4d95-8bad-07f55f08670b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:17 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 Apr 07 06:17:17 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:17 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.511s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:17 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:17 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 1G Apr 07 06:17:17 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:18 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.455s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:18 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Deleted volume successfully. Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7fcd6465-1e5d-4025-9e47-57b0e5047e5d tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-4832eb47-388a-431d-a905-dd6c6f0960ef-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:18 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70" returned: 0 in 0.500s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:18 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70 Apr 07 06:17:18 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:18 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 1G" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:18 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:18 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:18 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-f2b4e231-fdab-4985-bb5c-f928476e4f70" returned: 0 in 0.377s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-f2b4e231-fdab-4985-bb5c-f928476e4f70" released by "delete_volume" :: held 0.898s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Created reservations ['b29bf369-c5a8-4ea7-a2e8-c2edcde22f66', 'f55884b8-913c-41db-98cf-338a480b1f55', '6fed6004-1404-4222-ac96-36d6055bfac7', '1ba43299-3034-4137-9190-b4519f0001aa'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:18 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:18 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:18 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:18 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 is being set with open permissions: ugo+rw Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:18 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:18 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-quobyte-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f9d581-2fbb-4172-a17f-8c1571ace959]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:18 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:18 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 Apr 07 06:17:18 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:19 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.413s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:19 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Deleted volume successfully. Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4d41ec9f-0d5d-4edd-8430-f29793081e87 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-f2b4e231-fdab-4985-bb5c-f928476e4f70-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:19 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.420s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:19 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info Apr 07 06:17:19 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:19 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:19 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961 Apr 07 06:17:19 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:19 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info" returned: 0 in 0.401s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:19 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info is being set with open permissions: ugo+rw Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:19 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info Apr 07 06:17:19 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:19 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" returned: 0 in 0.397s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961" released by "delete_volume" :: held 0.898s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Created reservations ['441d16eb-8276-40b2-8e0a-63bc6cacec5a', 'c7aad735-8aff-4338-b371-4422d2d7802e', 'af353521-417f-4812-a7ba-86a57f7ad287', '0d7928f1-ee03-485e-bcfe-475b800b3868'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:19 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:19 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-quobyte-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" acquired by "delete_volume" :: waited 0.006s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c18cb-fd5a-4893-90a3-7749deada611]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:19 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:19 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.info" returned: 0 in 0.432s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.358s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating offline snapshot b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae of volume 95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38838a08-4816-4c18-8dd4-503b57fca040]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3a670456-23d8-46f8-b8c4-e37d05ab84cb tempest-VolumeDependencyTests-1738738937 None] Create snapshot completed successfully Apr 07 06:17:20 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 Apr 07 06:17:20 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:20 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f Apr 07 06:17:20 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:20 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.413s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:20 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Deleted volume successfully. Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0e7349ed-734f-46b1-865a-bcb096b91a6f tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-6545e4d5-3bce-4ccf-b7eb-4dcb31bf1961-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:20 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:20 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383 Apr 07 06:17:20 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:20 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:20 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae 1G Apr 07 06:17:20 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:20 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" returned: 0 in 0.397s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383" released by "delete_volume" :: held 0.885s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Created reservations ['ab2d552a-e0db-4a60-8aab-f22343bb2c0b', '3efe2e9a-917d-4a69-acb8-c6db26383532', '48ad2e80-8cee-4acb-a29b-272a41be8330', 'f691bb29-ec06-4de7-9c1b-28d04e62e67a'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:20 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:20 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:20 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-a0052fb1-656d-4cd4-b30f-e6eb8b46373d-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:21 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae 1G" returned: 0 in 0.528s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95325fdd-62bc-48dd-8edf-523aac00441f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-a0052fb1-656d-4cd4-b30f-e6eb8b46373d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:21 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95325fdd-62bc-48dd-8edf-523aac00441f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae Apr 07 06:17:21 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "cinder-quobyte-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" acquired by "delete_volume" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cec3d4d-3e32-4a75-a12c-b1abdc7427ee]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (91692cff-82fc-4fb7-8392-8bc247848df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d266f-0681-48e6-954c-de3a7533df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d266f-0681-48e6-954c-de3a7533df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1493361069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:21Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34869896-63bb-48f6-967a-e7fb91767b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34869896-63bb-48f6-967a-e7fb91767b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d5e269-5360-4b3b-82c4-2131d078ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d5e269-5360-4b3b-82c4-2131d078ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c', 'volume_name': 'volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c', 'volume_size': 1, 'snapshot_id': '5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4836e50c-8147-41d2-881a-f9db3e4df6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4836e50c-8147-41d2-881a-f9db3e4df6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e60c69b-1ce3-4fea-bfbc-452595dee9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:21 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Volume b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c', 'volume_size': 1, 'snapshot_id': '5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409'} Apr 07 06:17:21 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d Apr 07 06:17:21 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:21 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.479s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:21 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Deleted volume successfully. Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9f2376ee-943e-4c91-ad3a-0d658a77fe9a tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-6800c2db-7d9d-4fbf-9cf2-d4fc65f34383-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:21 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95325fdd-62bc-48dd-8edf-523aac00441f -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" returned: 0 in 0.458s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:21 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae is being set with open permissions: ugo+rw Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:21 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae Apr 07 06:17:21 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:21 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" returned: 0 in 0.479s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:21 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d Apr 07 06:17:21 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:21 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" returned: 0 in 0.391s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:21 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:21 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info Apr 07 06:17:21 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:22 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" returned: 0 in 0.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-quobyte-a0052fb1-656d-4cd4-b30f-e6eb8b46373d" released by "delete_volume" :: held 0.907s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Created reservations ['a867d92f-23b7-48d6-ada1-da04bcb32994', '7688b7d5-fcdd-4723-820c-35def8a9a55f', 'de04a961-877f-4054-a87a-057a252e6e18', '0fbb3d0a-f4e7-461a-8b55-39e40e5680b4'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:22 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:22 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:22 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info" returned: 0 in 0.443s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:22 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info is being set with open permissions: ugo+rw Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:22 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info Apr 07 06:17:22 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:22 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.466s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Deleted volume successfully. Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-a23627e0-044b-4f32-a926-6393e261cc59 tempest-CreateVolumesFromImageTest-1602027023 None] Lock "cinder-a0052fb1-656d-4cd4-b30f-e6eb8b46373d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:22 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.info" returned: 0 in 0.479s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.840s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Creating offline snapshot 2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 of volume 56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:17:22 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b533d3d2-8362-4606-80d6-67f060c10e6c tempest-CreateVolumesFromSnapshotTest-925226029 None] Create snapshot completed successfully Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ae4f46-4a06-4b61-80ca-687c4aca46f9]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:22 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:22 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 Apr 07 06:17:22 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:23 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8" returned: 0 in 0.509s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:23 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 1G Apr 07 06:17:23 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:23 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 1G" returned: 0 in 0.545s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c114ec-2731-4396-929a-6b525686f7e8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:23 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c114ec-2731-4396-929a-6b525686f7e8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 Apr 07 06:17:23 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (8177febd-24b1-4a33-8c5a-09a945089302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:23 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a092324-e990-4754-872c-3dd3499d1bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a092324-e990-4754-872c-3dd3499d1bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151452708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d74375-7c43-4099-b966-fb5cba08e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a496fe-6740-43aa-be15-8b344943d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a496fe-6740-43aa-be15-8b344943d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21650d28-cedf-47fb-8966-0b5e80fad760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21650d28-cedf-47fb-8966-0b5e80fad760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d74375-7c43-4099-b966-fb5cba08e672', 'volume_name': 'volume-15d74375-7c43-4099-b966-fb5cba08e672', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e6a79d-ddb2-49ba-a896-7293af264257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e6a79d-ddb2-49ba-a896-7293af264257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b710a5-d8e3-4991-8bcf-00e44556e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume 15d74375-7c43-4099-b966-fb5cba08e672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d74375-7c43-4099-b966-fb5cba08e672', 'volume_size': 1} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (93d38b59-d6c8-4f44-8bfa-a9d6f3f71c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f8dd13-cc5a-4229-80a5-9274c71a4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f8dd13-cc5a-4229-80a5-9274c71a4c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046820319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac166647-1a29-47e8-893a-c0c0f1327f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36200e7-7bcd-4acd-99c3-e0c8ee9e3b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36200e7-7bcd-4acd-99c3-e0c8ee9e3b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad231fce-a3fd-4c7d-ad9e-b1f67a5d1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad231fce-a3fd-4c7d-ad9e-b1f67a5d1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac166647-1a29-47e8-893a-c0c0f1327f4e', 'volume_name': 'volume-ac166647-1a29-47e8-893a-c0c0f1327f4e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf218e4-ce12-4438-8f9d-b252bccd2dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf218e4-ce12-4438-8f9d-b252bccd2dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e34bc3-54ad-4f30-ad25-99e9a726e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume ac166647-1a29-47e8-893a-c0c0f1327f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac166647-1a29-47e8-893a-c0c0f1327f4e', 'volume_size': 1} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (4dd0f878-997a-4d04-a113-f54750ddca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e06a02-6188-4333-9694-3244513ea8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e06a02-6188-4333-9694-3244513ea8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779939312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76843189-7fff-4c69-b128-3ca0dcbd8d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76843189-7fff-4c69-b128-3ca0dcbd8d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495def36-2b72-4594-8954-c17f08224dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495def36-2b72-4594-8954-c17f08224dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88', 'volume_name': 'volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0173ad-d633-45c2-abda-6bf926d5e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0173ad-d633-45c2-abda-6bf926d5e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787588d0-e655-4f4f-a98c-08f1d09c6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume 2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88', 'volume_size': 1} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c114ec-2731-4396-929a-6b525686f7e8 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" returned: 0 in 0.513s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:24 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 is being set with open permissions: ugo+rw Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:24 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 Apr 07 06:17:24 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (adba1910-bbfc-41ec-b9c0-2aabdd21189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f11426-1673-4559-bf86-f33fc4b7e54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f11426-1673-4559-bf86-f33fc4b7e54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152387175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e059c668-2c51-4edb-9527-b657f4d408ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184bd5c3-6856-4b10-ad3a-a753df438a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184bd5c3-6856-4b10-ad3a-a753df438a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600fbe9-bd90-4d89-a263-869513639c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600fbe9-bd90-4d89-a263-869513639c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e059c668-2c51-4edb-9527-b657f4d408ca', 'volume_name': 'volume-e059c668-2c51-4edb-9527-b657f4d408ca', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880cb95e-aa0a-49b8-9e15-9352cc894401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880cb95e-aa0a-49b8-9e15-9352cc894401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4438e-b8b1-4ac3-bc1b-bba8167bedc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume e059c668-2c51-4edb-9527-b657f4d408ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e059c668-2c51-4edb-9527-b657f4d408ca', 'volume_size': 1} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (9276264c-b54e-4c2d-9d44-a7669f941ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99beecae-8d94-4e00-80b2-cedbf5356edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99beecae-8d94-4e00-80b2-cedbf5356edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843875424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2703a6d7-f03d-45ea-a25b-54c1e66b8af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75827fb-8cfb-485f-9ad6-e817ecd095bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75827fb-8cfb-485f-9ad6-e817ecd095bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff70410-effd-4a85-96f0-2886eaadc50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff70410-effd-4a85-96f0-2886eaadc50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2703a6d7-f03d-45ea-a25b-54c1e66b8af4', 'volume_name': 'volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7f6c85-fd71-49ae-a641-bc55c5adfcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7f6c85-fd71-49ae-a641-bc55c5adfcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d07c945-0123-4d40-a5e7-8fcd2d7946d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:24 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume 2703a6d7-f03d-45ea-a25b-54c1e66b8af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4', 'volume_size': 1} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:24 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" returned: 0 in 0.402s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:24 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info Apr 07 06:17:24 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (ab2ccd53-a8f8-4330-a903-fb6dac3b40ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:24 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c896c7-7a7c-4dd7-88d4-9047e21fbb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c896c7-7a7c-4dd7-88d4-9047e21fbb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304072024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca2662e-c9f8-460b-bb4c-5b4be8e443ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f5e71a-2af9-403e-b344-aa27799d3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f5e71a-2af9-403e-b344-aa27799d3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b081b9-d1d0-43c7-a14a-068f0c9384ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b081b9-d1d0-43c7-a14a-068f0c9384ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca2662e-c9f8-460b-bb4c-5b4be8e443ce', 'volume_name': 'volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca851fd-c58b-4304-ad0f-f2a64ffe1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca851fd-c58b-4304-ad0f-f2a64ffe1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e03590-66a6-4308-9848-c3e54794f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:25 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume dca2662e-c9f8-460b-bb4c-5b4be8e443ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce', 'volume_size': 1} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:25 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info" returned: 0 in 0.429s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:25 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info is being set with open permissions: ugo+rw Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:25 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info Apr 07 06:17:25 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:25 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.info" returned: 0 in 0.401s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.487s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Creating volume b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c from snapshot 5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:25 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2fb4e6aa-1277-4cb8-8e2e-c0acf97379a7 tempest-CinderUnicodeTest-869163734 None] Create snapshot completed successfully Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] snapshot: 5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409, volume: b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96096c5a-9c61-4b46-abf3-2a87f64a6096]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:25 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:25 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:25 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:26 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1bd977-27d2-412b-ae94-c9f450b1b736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f6b06-ce87-4e61-b77c-e107dd8aa98a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:26 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:26 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-quobyte-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Deleting offline snapshot 2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 of volume 56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] snapshot_file for this snap is: volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74b8a7-3753-4497-a90e-b807aaefe007]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:26 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 Apr 07 06:17:26 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:26 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.471s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:26 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c Apr 07 06:17:26 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:26 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" returned: 0 in 0.443s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c114ec-2731-4396-929a-6b525686f7e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc172d2-340f-4705-9658-82e596b8802a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:26 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:26 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 Apr 07 06:17:26 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:27 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8" returned: 0 in 0.561s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:27 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:27 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 Apr 07 06:17:27 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:28 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" returned: 0 in 0.908s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:28 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2 Apr 07 06:17:28 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:28 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" returned: 0 in 2.075s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d261a-db21-46d6-9150-16f8c7fd8850]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:28 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:28 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:28 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:28 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8.2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" returned: 0 in 0.647s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2" released by "_delete_snapshot" :: held 2.621s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" released by "delete_snapshot" :: held 2.634s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Created reservations ['09371b47-c0ec-48f5-b620-7cefd6353dfb', '5feccd6f-3942-4660-8603-8a54f7048290', '1745f849-b574-4b48-8565-7409ec01efff', '2e3b036a-cc2d-456f-a55b-feca58c93c8f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Delete snapshot completed successfully. Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-8550f32b-d3f1-4d85-8ca2-7f1676a43dd8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-2d51053b-a6ba-4ab8-a24d-a8fb66d899d2-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:29 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.599s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:17:29 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Converted 1024.00 MB image at 493.16 MB/s Apr 07 06:17:29 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c is being set with open permissions: ugo+rw Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:29 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c Apr 07 06:17:29 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-56c114ec-2731-4396-929a-6b525686f7e8-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-56c114ec-2731-4396-929a-6b525686f7e8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" acquired by "delete_volume" :: waited 0.006s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ab96c2-40d9-433c-922d-a356121dff82]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:29 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 Apr 07 06:17:29 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:29 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" returned: 0 in 0.405s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" released by "_copy_volume_from_snapshot" :: held 4.073s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" released by "_create_volume_from_snapshot" :: held 4.095s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.115s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.823s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151452708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d74375-7c43-4099-b966-fb5cba08e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume 15d74375-7c43-4099-b966-fb5cba08e672 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:29 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:29 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 1073741824 Apr 07 06:17:29 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e60c69b-1ce3-4fea-bfbc-452595dee9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c', 'volume_size': 1, 'snapshot_id': '5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec33e537-e370-4cc1-bf7f-e126ec14d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:29 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Volume volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c (b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c): created successfully Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec33e537-e370-4cc1-bf7f-e126ec14d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:29 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (91692cff-82fc-4fb7-8392-8bc247848df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:29 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0f06a2f2-60f9-40f8-b6a1-357ed1e31a3e tempest-VolumeDependencyTests-1738738937 None] Created volume successfully. Apr 07 06:17:30 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8 Apr 07 06:17:30 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:30 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 1073741824" returned: 0 in 0.502s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 Apr 07 06:17:30 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:30 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-56c114ec-2731-4396-929a-6b525686f7e8" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-56c114ec-2731-4396-929a-6b525686f7e8" released by "delete_volume" :: held 0.961s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Created reservations ['e9e4f6d3-f45b-46e0-8228-aa0756eb9888', '6823b1a0-22b3-44f0-9f94-b93373030df4', '5fc2b71a-31ce-4a4b-b078-7f649f1ab7a5', '9541c544-2671-49b1-a5b6-891282945c33'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:30 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-b98e132b-19bc-4f63-8dde-347ebbe0e6d6-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "cinder-b98e132b-19bc-4f63-8dde-347ebbe0e6d6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Acquiring lock "cinder-quobyte-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ddfcc0-c48b-4064-9aef-1d025070290b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672" returned: 0 in 0.416s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.582s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046820319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac166647-1a29-47e8-893a-c0c0f1327f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume ac166647-1a29-47e8-893a-c0c0f1327f4e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:30 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 Apr 07 06:17:30 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:30 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:30 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e 1073741824 Apr 07 06:17:30 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b710a5-d8e3-4991-8bcf-00e44556e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d74375-7c43-4099-b966-fb5cba08e672', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4e46ef-79f4-476c-ae5f-79b0ffb60671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:30 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-15d74375-7c43-4099-b966-fb5cba08e672 (15d74375-7c43-4099-b966-fb5cba08e672): created successfully Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4e46ef-79f4-476c-ae5f-79b0ffb60671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (8177febd-24b1-4a33-8c5a-09a945089302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:30 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-97738cef-0d2b-43f3-a34a-3e4656b81b6e tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Deleting offline snapshot 5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 of volume dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] snapshot_file for this snap is: volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652c23c-ff23-4eb4-ae48-0d6ada16a779]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:30 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:30 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:30 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.473s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:31 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Deleted volume successfully. Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e80afd52-c032-40e5-9d1d-14134557b3a8 tempest-CinderUnicodeTest-869163734 None] Lock "cinder-56c114ec-2731-4396-929a-6b525686f7e8-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:31 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" returned: 0 in 0.489s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:31 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6 Apr 07 06:17:31 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e 1073741824" returned: 0 in 0.546s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:31 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e Apr 07 06:17:31 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.526s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1bd977-27d2-412b-ae94-c9f450b1b736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[614b55e7-65a5-4e14-b174-d54865378290]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:31 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:31 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (d40dbe19-b8a5-443a-b38a-715a0c11e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:31 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986f849-8d41-46ef-94bc-830282193791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" returned: 0 in 0.493s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986f849-8d41-46ef-94bc-830282193791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617759597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ba6118-12e0-4962-a016-24f125eead7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9a1a05-c097-4c2a-a927-35f2bb66a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9a1a05-c097-4c2a-a927-35f2bb66a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455fa810-7584-477c-a643-a1066cf7fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455fa810-7584-477c-a643-a1066cf7fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ba6118-12e0-4962-a016-24f125eead7e', 'volume_name': 'volume-18ba6118-12e0-4962-a016-24f125eead7e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7ad0e8-7a1d-4333-8120-c75389c87f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7ad0e8-7a1d-4333-8120-c75389c87f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e831c2e-dcd3-4c58-8bef-847c551663a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume 18ba6118-12e0-4962-a016-24f125eead7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ba6118-12e0-4962-a016-24f125eead7e', 'volume_size': 1} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "cinder-quobyte-b98e132b-19bc-4f63-8dde-347ebbe0e6d6" released by "delete_volume" :: held 1.039s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Created reservations ['f253dd9b-2a56-4def-a046-aaf3568dac96', 'e67923e1-732b-4789-a976-ad99c27de85d', '6836a70c-c0b8-406e-8b1a-14a058ba2aaf', '7f50d7cb-c348-49bb-a947-d18c7540be58'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:31 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.432s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779939312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:24Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume 2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:31 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:31 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:31 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e34bc3-54ad-4f30-ad25-99e9a726e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac166647-1a29-47e8-893a-c0c0f1327f4e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 1073741824 Apr 07 06:17:31 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0cf36a-c770-400a-8767-f35be340d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:31 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-ac166647-1a29-47e8-893a-c0c0f1327f4e (ac166647-1a29-47e8-893a-c0c0f1327f4e): created successfully Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0cf36a-c770-400a-8767-f35be340d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (93d38b59-d6c8-4f44-8bfa-a9d6f3f71c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (8ee47721-02c7-45f8-9aee-636c4f930c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:31 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8788fcd-2fee-4f39-a9b8-47f8a18f3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4fe484b7-5b2f-495b-8b26-123549b3b088 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8788fcd-2fee-4f39-a9b8-47f8a18f3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294188575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6792339-ad38-4b43-98b7-f26fc6fd4688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccfb0ea-763a-49a4-b67a-d77108505437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccfb0ea-763a-49a4-b67a-d77108505437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f94da08-7967-4c49-81dc-b9649e320e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f94da08-7967-4c49-81dc-b9649e320e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6792339-ad38-4b43-98b7-f26fc6fd4688', 'volume_name': 'volume-b6792339-ad38-4b43-98b7-f26fc6fd4688', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21790a56-ed78-4ffb-b695-f6e98e6020d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21790a56-ed78-4ffb-b695-f6e98e6020d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43b8e54-e650-43dd-a140-faafa864e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume b6792339-ad38-4b43-98b7-f26fc6fd4688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6792339-ad38-4b43-98b7-f26fc6fd4688', 'volume_size': 1} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:32 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.627s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:32 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:32 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (a94cb30f-0245-4db9-9180-04ea9cae5126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f34e48b-0690-4107-b14b-b6c27c607b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f34e48b-0690-4107-b14b-b6c27c607b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2139440067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253d713a-dc7a-4211-882a-813f5dd0e004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e36233-96b1-4762-8178-6f4c68bffc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e36233-96b1-4762-8178-6f4c68bffc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8736fa7e-4a53-4cce-8630-c5ef5c9af588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8736fa7e-4a53-4cce-8630-c5ef5c9af588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253d713a-dc7a-4211-882a-813f5dd0e004', 'volume_name': 'volume-253d713a-dc7a-4211-882a-813f5dd0e004', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc98084-a8da-4cec-be19-6638d8d2e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc98084-a8da-4cec-be19-6638d8d2e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa355d-7b49-4cf0-8dc8-7729306945a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume 253d713a-dc7a-4211-882a-813f5dd0e004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253d713a-dc7a-4211-882a-813f5dd0e004', 'volume_size': 1} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (3c01dce2-d7ff-4460-b3ee-e207e157bb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9d339-d6f7-4386-9680-464930226273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9d339-d6f7-4386-9680-464930226273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651887676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66ac98d-3a46-4302-aa03-4ab431a52c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8dbb09-7d39-4070-96ce-88720a86d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8dbb09-7d39-4070-96ce-88720a86d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e40a273-6dd0-4cdb-9cc9-58d86a1e289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e40a273-6dd0-4cdb-9cc9-58d86a1e289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66ac98d-3a46-4302-aa03-4ab431a52c4f', 'volume_name': 'volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff31b4-a9ef-4a7f-bf34-2b4bf5b54e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff31b4-a9ef-4a7f-bf34-2b4bf5b54e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53b07ff-c3de-4600-85d7-4ce155e9b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume b66ac98d-3a46-4302-aa03-4ab431a52c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f', 'volume_size': 1} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.687s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Deleted volume successfully. Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-27f7a096-a7d9-4bcb-bee7-7179d35d3ded tempest-CinderUnicodeTest-869163734 None] Lock "cinder-b98e132b-19bc-4f63-8dde-347ebbe0e6d6-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:32 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 1073741824" returned: 0 in 0.696s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:32 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 Apr 07 06:17:32 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (c64e15b0-3971-4a73-a2c5-227ad0205bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382cfa2a-5907-4505-8230-7f91148c1205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382cfa2a-5907-4505-8230-7f91148c1205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759065571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bb4f74-30b1-4413-935e-702a15d9e1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:33Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99ecd2f-f2db-4a24-90ec-96324fe683d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99ecd2f-f2db-4a24-90ec-96324fe683d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4df701-c693-4460-98f1-b5ea51eecc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4df701-c693-4460-98f1-b5ea51eecc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bb4f74-30b1-4413-935e-702a15d9e1f3', 'volume_name': 'volume-20bb4f74-30b1-4413-935e-702a15d9e1f3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6616b860-68e8-4f66-a5f9-f41e07d23f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6616b860-68e8-4f66-a5f9-f41e07d23f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d8d6c5-eda4-49a4-8a8d-a643aaeb4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:32 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume 20bb4f74-30b1-4413-935e-702a15d9e1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bb4f74-30b1-4413-935e-702a15d9e1f3', 'volume_size': 1} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.676s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:32 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:32 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409 Apr 07 06:17:32 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:33 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" returned: 0 in 0.472s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.483s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152387175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e059c668-2c51-4edb-9527-b657f4d408ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume e059c668-2c51-4edb-9527-b657f4d408ca {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:33 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787588d0-e655-4f4f-a98c-08f1d09c6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ed0473-499d-44cf-a5f7-a02cdf21aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:33 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca 1073741824 Apr 07 06:17:33 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:33 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 (2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88): created successfully Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ed0473-499d-44cf-a5f7-a02cdf21aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (4dd0f878-997a-4d04-a113-f54750ddca5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-29ce7c4f-e734-4a85-b0b1-cd306172244d tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:33 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736.5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" returned: 0 in 0.451s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409" released by "_delete_snapshot" :: held 2.339s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" released by "delete_snapshot" :: held 2.353s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Created reservations ['fab686bb-8090-4095-8ef0-ff56ff031420', 'e8f2bdb1-0132-4d41-bd66-c2877342d91f', 'fc574e79-9ba1-470e-8ccf-bc33d8c2fa6e', '36f3f371-6c43-4a08-b0ec-d797c3fb6e90'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:33 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Delete snapshot completed successfully. Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-207a9ab4-e04a-4c5e-b518-fad8d1aeba74 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-5eb3a4cb-c3c5-42ad-94a5-34fbdffb0409-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:33 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca 1073741824" returned: 0 in 0.551s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:33 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca Apr 07 06:17:33 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:33 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-dc1bd977-27d2-412b-ae94-c9f450b1b736-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-dc1bd977-27d2-412b-ae94-c9f450b1b736-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b687e070-924f-43a6-b3c7-3161c4c4af26]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:34 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:34 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:34 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca" returned: 0 in 0.477s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.341s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843875424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2703a6d7-f03d-45ea-a25b-54c1e66b8af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume 2703a6d7-f03d-45ea-a25b-54c1e66b8af4 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:34 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4438e-b8b1-4ac3-bc1b-bba8167bedc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e059c668-2c51-4edb-9527-b657f4d408ca', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9076b99c-7ba2-4984-ac16-9b833dad5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:34 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 1073741824 Apr 07 06:17:34 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:34 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-e059c668-2c51-4edb-9527-b657f4d408ca (e059c668-2c51-4edb-9527-b657f4d408ca): created successfully Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9076b99c-7ba2-4984-ac16-9b833dad5eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (adba1910-bbfc-41ec-b9c0-2aabdd21189e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:34 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-23dfc76d-8dd7-428e-8afb-35292a6f8a31 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:34 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.578s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:34 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736 Apr 07 06:17:34 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:34 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 1073741824" returned: 0 in 0.549s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:34 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:34 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 Apr 07 06:17:34 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:35 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dc1bd977-27d2-412b-ae94-c9f450b1b736" returned: 0 in 0.501s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-dc1bd977-27d2-412b-ae94-c9f450b1b736" released by "delete_volume" :: held 1.125s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Created reservations ['6eb1ddf3-d9a4-4e6c-bf4a-9f45c1392b0e', '09e052fc-1265-4e31-ac05-6ad068f6ae28', '5405c2e4-877d-4b25-b3bc-a489d553ba14', '54a5f918-a271-4ad4-9552-294fdd41a328'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:35 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.188s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304072024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca2662e-c9f8-460b-bb4c-5b4be8e443ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f60ebd7b86b46deb5057ef959f0d2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:25Z,use_quota=True,user_id='ee4dc8262ff44fb9b4ff3eac205aa9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Creating volume dca2662e-c9f8-460b-bb4c-5b4be8e443ce {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:35 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:35 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce 1073741824 Apr 07 06:17:35 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d07c945-0123-4d40-a5e7-8fcd2d7946d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dba2a5-d967-4fad-b815-849ad37d317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:35 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 (2703a6d7-f03d-45ea-a25b-54c1e66b8af4): created successfully Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dba2a5-d967-4fad-b815-849ad37d317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:35 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (9276264c-b54e-4c2d-9d44-a7669f941ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:35 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-69178d9f-c903-416e-835f-71f7eb0c4c38 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:35 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:35 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.485s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:35 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Deleted volume successfully. Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce 1073741824" returned: 0 in 0.549s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-78620b7e-3011-4e64-b884-0bc50c5859a3 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-dc1bd977-27d2-412b-ae94-c9f450b1b736-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:35 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:35 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce Apr 07 06:17:35 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:36 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" returned: 0 in 0.426s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617759597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ba6118-12e0-4962-a016-24f125eead7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume 18ba6118-12e0-4962-a016-24f125eead7e {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:36 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e03590-66a6-4308-9848-c3e54794f52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d8a343-719b-4d14-a03b-4e4c08612685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e 1073741824 Apr 07 06:17:36 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Volume volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce (dca2662e-c9f8-460b-bb4c-5b4be8e443ce): created successfully Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d8a343-719b-4d14-a03b-4e4c08612685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Flow 'volume_create_manager' (ab2ccd53-a8f8-4330-a903-fb6dac3b40ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:36 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-2ff08b8c-f931-4977-8807-e9a2a8f77228 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created volume successfully. Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (3a3f9037-be2e-489f-ad83-2828490e8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c30e8-b204-4006-9639-a74f8667544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c30e8-b204-4006-9639-a74f8667544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1017430556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:36Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe904a89-a91e-439d-8064-42c6a240104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe904a89-a91e-439d-8064-42c6a240104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb9af7-fed6-4722-86de-a833bce905a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb9af7-fed6-4722-86de-a833bce905a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'volume_name': 'volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893b267-c128-4f76-9b02-10ea7c38b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893b267-c128-4f76-9b02-10ea7c38b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ff321-86d2-4163-9603-ca757d11d2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:36 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Volume 0ba4a4aa-811e-43cc-8d47-e01a1a7f7159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'volume_size': 1} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-dca2662e-c9f8-460b-bb4c-5b4be8e443ce-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:36 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e 1073741824" returned: 0 in 0.590s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-dca2662e-c9f8-460b-bb4c-5b4be8e443ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:36 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e Apr 07 06:17:36 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db7a29-ae71-4509-958f-c04999a352ce]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:36 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:36 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce Apr 07 06:17:36 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:37 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e" returned: 0 in 0.386s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.230s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294188575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6792339-ad38-4b43-98b7-f26fc6fd4688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume b6792339-ad38-4b43-98b7-f26fc6fd4688 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:37 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e831c2e-dcd3-4c58-8bef-847c551663a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ba6118-12e0-4962-a016-24f125eead7e', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:37 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 1073741824 Apr 07 06:17:37 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9714d1-4e40-40a1-a5fa-85efc85b89fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:37 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-18ba6118-12e0-4962-a016-24f125eead7e (18ba6118-12e0-4962-a016-24f125eead7e): created successfully Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9714d1-4e40-40a1-a5fa-85efc85b89fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (d40dbe19-b8a5-443a-b38a-715a0c11e623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:37 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-58f0facc-c988-4808-8019-86baf2af0983 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:37 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:37 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce Apr 07 06:17:37 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:37 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 1073741824" returned: 0 in 0.478s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:37 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 Apr 07 06:17:37 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:37 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" returned: 0 in 0.411s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-dca2662e-c9f8-460b-bb4c-5b4be8e443ce" released by "delete_volume" :: held 0.919s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['64e31632-8d46-4168-bee5-e3c423b7fe26', '1785bc0e-5df9-4be7-a034-c9cb4146efdc', '32abefe7-cbd2-491c-a35f-a6c760a18eba', 'c87e58b3-7a5d-4b08-8efb-4623786f9f56'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-2703a6d7-f03d-45ea-a25b-54c1e66b8af4-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:37 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:37 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:37 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-2703a6d7-f03d-45ea-a25b-54c1e66b8af4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" acquired by "delete_volume" :: waited 0.034s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4a721-9b99-4331-871b-7cc8c5cfc591]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:38 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 Apr 07 06:17:38 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:38 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688" returned: 0 in 0.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.996s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2139440067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253d713a-dc7a-4211-882a-813f5dd0e004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume 253d713a-dc7a-4211-882a-813f5dd0e004 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:38 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43b8e54-e650-43dd-a140-faafa864e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6792339-ad38-4b43-98b7-f26fc6fd4688', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0343993-f379-4c5d-93d5-eec154ca199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:38 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 (b6792339-ad38-4b43-98b7-f26fc6fd4688): created successfully Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0343993-f379-4c5d-93d5-eec154ca199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (8ee47721-02c7-45f8-9aee-636c4f930c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-05f47d27-e0d2-42ac-ad8c-8ae30e9326ae tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:38 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 1073741824 Apr 07 06:17:38 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:38 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.611s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:38 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-c6853c61-f1e3-4556-a819-0ab99a5a6836 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-dca2662e-c9f8-460b-bb4c-5b4be8e443ce-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:38 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" returned: 0 in 0.615s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:38 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4 Apr 07 06:17:38 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:38 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 1073741824" returned: 0 in 0.559s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:38 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:38 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 Apr 07 06:17:38 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:39 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" returned: 0 in 0.453s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-2703a6d7-f03d-45ea-a25b-54c1e66b8af4" released by "delete_volume" :: held 1.126s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['76b1e473-3763-4a78-b467-7b1eced26410', '625c8700-bd83-4103-9d8a-4fb957e29fd8', 'abf1c66d-0cae-44ca-854b-7a575f301e14', 'a5c12414-dec7-45ee-9709-8a710bd45528'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:39 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004" returned: 0 in 0.450s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:39 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:39 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.781s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651887676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66ac98d-3a46-4302-aa03-4ab431a52c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:32Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume b66ac98d-3a46-4302-aa03-4ab431a52c4f {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:39 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa355d-7b49-4cf0-8dc8-7729306945a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253d713a-dc7a-4211-882a-813f5dd0e004', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2607092-5c83-4d9a-b172-98b7f913601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:39 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f 1073741824 Apr 07 06:17:39 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:39 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-253d713a-dc7a-4211-882a-813f5dd0e004 (253d713a-dc7a-4211-882a-813f5dd0e004): created successfully Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2607092-5c83-4d9a-b172-98b7f913601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (a94cb30f-0245-4db9-9180-04ea9cae5126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:39 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b78cd4de-00e3-461b-95d4-54a40ef95e91 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:39 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.408s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:39 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-bda919e8-a7e8-444b-a736-25694c854c3a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-2703a6d7-f03d-45ea-a25b-54c1e66b8af4-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:39 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f 1073741824" returned: 0 in 0.551s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:39 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:39 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f Apr 07 06:17:39 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-e059c668-2c51-4edb-9527-b657f4d408ca-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-e059c668-2c51-4edb-9527-b657f4d408ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-e059c668-2c51-4edb-9527-b657f4d408ca" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:40 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-e059c668-2c51-4edb-9527-b657f4d408ca" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f" returned: 0 in 0.490s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99edc0a0-5ef2-4e83-bfeb-a2b06239fd12]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.628s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759065571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bb4f74-30b1-4413-935e-702a15d9e1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896ae08f8b384d9299770e2810b2d583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:33Z,use_quota=True,user_id='5da59c6caeb44da18c6854c6315ee3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Creating volume 20bb4f74-30b1-4413-935e-702a15d9e1f3 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:40 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:40 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 1073741824 Apr 07 06:17:40 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53b07ff-c3de-4600-85d7-4ce155e9b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e41f962-bc8c-489c-8156-7680b98ba99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:40 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f (b66ac98d-3a46-4302-aa03-4ab431a52c4f): created successfully Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e41f962-bc8c-489c-8156-7680b98ba99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (3c01dce2-d7ff-4460-b3ee-e207e157bb76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:40 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-522efae9-ac70-4dec-9ccd-94cbdf3ea183 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:40 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca Apr 07 06:17:40 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:40 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca" returned: 0 in 0.559s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:40 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:40 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 1073741824" returned: 0 in 0.588s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:40 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca Apr 07 06:17:40 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:41 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 Apr 07 06:17:41 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:41 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-e059c668-2c51-4edb-9527-b657f4d408ca" returned: 0 in 0.489s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:41 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-e059c668-2c51-4edb-9527-b657f4d408ca" released by "delete_volume" :: held 1.097s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3" returned: 0 in 0.472s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.057s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1017430556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:36Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Creating volume 0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:41 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:41 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 1073741824 Apr 07 06:17:41 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d8d6c5-eda4-49a4-8a8d-a643aaeb4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bb4f74-30b1-4413-935e-702a15d9e1f3', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3664439-45fd-487f-b62e-8d4bddf943f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:41 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Volume volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 (20bb4f74-30b1-4413-935e-702a15d9e1f3): created successfully Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3664439-45fd-487f-b62e-8d4bddf943f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Flow 'volume_create_manager' (c64e15b0-3971-4a73-a2c5-227ad0205bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:41 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-f19340c5-44f0-4b66-bb16-62d7f52076cb tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created volume successfully. Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['78335132-c2c8-46cb-b584-048f6c40480c', 'd18401cb-483e-497d-a83e-0746d2f75a22', 'f3eda00f-069e-4279-a859-d1bb68adb1cd', '6c8f68f1-42f5-40bc-a1d5-e4c0816652e6'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:41 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:41 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:41 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:42 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 1073741824" returned: 0 in 0.546s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:42 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.450s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-40747cd7-564c-4c60-85ff-c525ad5c02c5 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-e059c668-2c51-4edb-9527-b657f4d408ca-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:42 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:42 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-20bb4f74-30b1-4413-935e-702a15d9e1f3-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-20bb4f74-30b1-4413-935e-702a15d9e1f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:42 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-20bb4f74-30b1-4413-935e-702a15d9e1f3" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.491s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-20bb4f74-30b1-4413-935e-702a15d9e1f3" acquired by "delete_volume" :: waited 0.017s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ff321-86d2-4163-9603-ca757d11d2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078abbeb-9450-44b2-bce4-e830e90b603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4726a8c-1f28-4eb5-b46a-f4798af7c14f]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:42 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Volume volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 (0ba4a4aa-811e-43cc-8d47-e01a1a7f7159): created successfully Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078abbeb-9450-44b2-bce4-e830e90b603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (3a3f9037-be2e-489f-ad83-2828490e8c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:42 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-81fcaae6-4c9e-42ce-8e90-7a61a3372c4b tempest-VolumeDependencyTests-1738738937 None] Created volume successfully. Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d704a29f-e256-4a8b-b52c-6d2a72330677]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:42 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:42 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 Apr 07 06:17:42 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:42 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 Apr 07 06:17:42 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (94db4958-19e8-457a-83a9-7bf16367d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410288f8-170a-41c4-82d6-6b2a260f3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410288f8-170a-41c4-82d6-6b2a260f3edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-28156384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f23ee06-7904-4ecb-bfd6-274904751b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d353b99745d4637b3b053ef8eaa6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:43Z,use_quota=True,user_id='02b746e7909d443f934c977c3ad9ec8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73d133d-89b4-450f-99df-043f106d994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73d133d-89b4-450f-99df-043f106d994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0bae2e-523e-4c0d-bc7e-6f09760571a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0bae2e-523e-4c0d-bc7e-6f09760571a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9f23ee06-7904-4ecb-bfd6-274904751b81', 'volume_name': 'volume-9f23ee06-7904-4ecb-bfd6-274904751b81', 'volume_size': 1, 'source_volid': '0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a6960-ecec-4f34-983e-95d8db9d0521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a6960-ecec-4f34-983e-95d8db9d0521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de52d46-a387-4f09-8f17-24df780531b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:43 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Volume 9f23ee06-7904-4ecb-bfd6-274904751b81: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9f23ee06-7904-4ecb-bfd6-274904751b81', 'volume_size': 1, 'source_volid': '0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'source_volstatus': 'available'} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:43 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Cloning volume 0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 to volume 9f23ee06-7904-4ecb-bfd6-274904751b81 Apr 07 06:17:43 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3" returned: 0 in 0.577s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3 Apr 07 06:17:43 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Creating offline snapshot 35c61381-ab35-459f-beb3-df6f3a067c0c of volume 0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5005f2-f2bf-45a8-995a-0232ea949aee]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" returned: 0 in 0.599s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88 Apr 07 06:17:43 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:43 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-20bb4f74-30b1-4413-935e-702a15d9e1f3" returned: 0 in 0.494s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-20bb4f74-30b1-4413-935e-702a15d9e1f3" released by "delete_volume" :: held 1.105s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['b78fb034-cef2-479e-82e6-de1d6e2c0f91', '342046d3-47d9-4ea7-a7dc-bd684c8fbbad', '34d5643f-be9d-4784-85d7-4e772aa7897b', '4bd64c47-c3b8-492d-9fcd-f3de281e62ca'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:43 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88" released by "delete_volume" :: held 1.089s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.576s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:43 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['431b3e5a-adb4-4af2-81bc-95f36663906c', '085d25ac-93bc-4292-89ee-b551922a6e9c', '0e625d67-7c40-45c7-93f7-25dd75a30bbf', '72a350fc-372b-4818-a55e-8b644228bdae'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:43 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c 1G Apr 07 06:17:43 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:43 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:43 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:43 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:44 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.470s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-e4fe53e7-69c2-444b-a4b1-9210fecfe8ac tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-20bb4f74-30b1-4413-935e-702a15d9e1f3-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:44 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c 1G" returned: 0 in 0.637s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:44 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:44 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:44 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.665s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:44 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-0fd05d2d-8da7-4390-8415-5fddcbe70f1e tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-2eefd41b-a6ab-4f6d-8809-8ae9a5d50c88-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-b66ac98d-3a46-4302-aa03-4ab431a52c4f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-b66ac98d-3a46-4302-aa03-4ab431a52c4f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-b66ac98d-3a46-4302-aa03-4ab431a52c4f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-b66ac98d-3a46-4302-aa03-4ab431a52c4f" acquired by "delete_volume" :: waited 0.022s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-ac166647-1a29-47e8-893a-c0c0f1327f4e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f21bd-bac8-4de0-9319-72f5c805e5d4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-ac166647-1a29-47e8-893a-c0c0f1327f4e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-ac166647-1a29-47e8-893a-c0c0f1327f4e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-ac166647-1a29-47e8-893a-c0c0f1327f4e" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b4e19-e0d0-498e-8763-03accf2150fe]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:44 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:45 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.547s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c is being set with open permissions: ugo+rw Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:45 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:45 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f Apr 07 06:17:45 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e Apr 07 06:17:45 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e" returned: 0 in 0.516s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:45 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.487s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e Apr 07 06:17:45 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:45 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f" returned: 0 in 0.666s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:45 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info Apr 07 06:17:45 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f Apr 07 06:17:45 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:45 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-ac166647-1a29-47e8-893a-c0c0f1327f4e" returned: 0 in 0.433s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-ac166647-1a29-47e8-893a-c0c0f1327f4e" released by "delete_volume" :: held 0.974s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:45 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info" returned: 0 in 0.447s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:45 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info is being set with open permissions: ugo+rw Apr 07 06:17:45 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:46 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info Apr 07 06:17:46 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:46 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b66ac98d-3a46-4302-aa03-4ab431a52c4f" returned: 0 in 0.478s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-b66ac98d-3a46-4302-aa03-4ab431a52c4f" released by "delete_volume" :: held 1.189s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['28555d14-cb2a-4fee-9136-fff71c21bd5d', '9d38565e-c099-4976-b6ea-c687f06de80f', 'a585f67f-1fca-4184-aadb-9159d7d5471b', 'c90ffcad-c99a-46ef-a2c0-958df1f3dccd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['7ba1f197-aba4-4c05-9aaf-d34b43ffd56a', '4f500ffb-fc27-4dc0-be34-6f0eb31cf92a', '35a63df2-edf4-4324-9e37-7125e95b8f57', 'afe7fb43-384c-484f-a447-ebf8814a8e43'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:46 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:46 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:46 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:46 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_service.periodic_task [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83450) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:46 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:46 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:46 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.info" returned: 0 in 0.555s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] snapshot: 35c61381-ab35-459f-beb3-df6f3a067c0c, volume: 9f23ee06-7904-4ecb-bfd6-274904751b81, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26ae9e-c8b0-49a7-b9d5-1935d4c82e97]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:46 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:46 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:46 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.627s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:46 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-903acfbc-f4e6-4106-b7af-97f2f756c953 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-b66ac98d-3a46-4302-aa03-4ab431a52c4f-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.529s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b2f3136a-cdb8-4a02-8ac6-8af530b39f69 None None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:46 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.758s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:46 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:46 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-7f05a460-0ad0-4188-9ca1-8dc2b484894a tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-ac166647-1a29-47e8-893a-c0c0f1327f4e-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-253d713a-dc7a-4211-882a-813f5dd0e004-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-253d713a-dc7a-4211-882a-813f5dd0e004-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-253d713a-dc7a-4211-882a-813f5dd0e004" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-253d713a-dc7a-4211-882a-813f5dd0e004" acquired by "delete_volume" :: waited 0.027s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a79e0-c2b4-455f-9b7c-1e909df0a50e]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:47 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleting offline snapshot b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae of volume 95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] snapshot_file for this snap is: volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.662s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac0583-456c-4dc8-b3ab-94919f594371]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98fa0fe-a703-4c7e-88df-033d19b730cb]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae Apr 07 06:17:47 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 Apr 07 06:17:47 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:47 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:47 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:47 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:47 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004" returned: 0 in 0.566s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004 Apr 07 06:17:47 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:47 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" returned: 0 in 0.562s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95325fdd-62bc-48dd-8edf-523aac00441f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[520839cc-8d02-4776-8fc2-7d059c429aab]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.596s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:17:47 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:47 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 Apr 07 06:17:47 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:47 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f Apr 07 06:17:47 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:48 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-253d713a-dc7a-4211-882a-813f5dd0e004" returned: 0 in 0.625s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-253d713a-dc7a-4211-882a-813f5dd0e004" released by "delete_volume" :: held 1.246s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['2bab0b84-6f9b-4093-b791-fac245e8f37f', 'deea5ca8-18e1-43e7-bf0b-33e415f8db6f', 'd78f24eb-645f-4861-9645-8a87050fad0f', 'c8486753-f796-455d-b3a5-19ef2467ff31'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:48 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:48 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:48 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f" returned: 0 in 1.008s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:48 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:48 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae Apr 07 06:17:48 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-b6792339-ad38-4b43-98b7-f26fc6fd4688-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-b6792339-ad38-4b43-98b7-f26fc6fd4688-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-b6792339-ad38-4b43-98b7-f26fc6fd4688" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-b6792339-ad38-4b43-98b7-f26fc6fd4688" acquired by "delete_volume" :: waited 0.091s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[063dc4d0-7094-47a9-b47b-e12f6030335a]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:49 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:50 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 Apr 07 06:17:50 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:50 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 2.001s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:50 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-19ffaae7-1e9d-414b-b158-25899bc6ec0a tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-253d713a-dc7a-4211-882a-813f5dd0e004-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:50 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81" returned: 0 in 2.803s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[26abadd1-ef73-4e90-a590-19ad01906dc6]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:50 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:50 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:50 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" returned: 0 in 2.022s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:50 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae Apr 07 06:17:50 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:50 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688" returned: 0 in 1.001s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:50 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:50 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688 Apr 07 06:17:50 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Flow 'volume_create_manager' (88c9da07-4b25-4406-993a-ec94ba368e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a914909-5942-45ca-89c6-144f771a961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a914909-5942-45ca-89c6-144f771a961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-474255627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845808b6-3f2a-4d13-98e8-03feb4cd32d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c163a3e75744f29160c41f01f281d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:51Z,use_quota=True,user_id='0ff65df4f6c1400e92dd5b9b306fc6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a57056-0138-4241-8446-bbeba4bbbac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a57056-0138-4241-8446-bbeba4bbbac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3b7ddb-aafb-497b-bb9a-2951efec97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3b7ddb-aafb-497b-bb9a-2951efec97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845808b6-3f2a-4d13-98e8-03feb4cd32d7', 'volume_name': 'volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbffcfa5-5548-417d-a52b-226ed267581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbffcfa5-5548-417d-a52b-226ed267581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8e29b9-af37-497a-a511-0768bf42b058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:51 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Volume 845808b6-3f2a-4d13-98e8-03feb4cd32d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7', 'volume_size': 1} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:51 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b6792339-ad38-4b43-98b7-f26fc6fd4688" returned: 0 in 0.529s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-b6792339-ad38-4b43-98b7-f26fc6fd4688" released by "delete_volume" :: held 1.568s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:51 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f.b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" returned: 0 in 0.648s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae" released by "_delete_snapshot" :: held 4.313s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" released by "delete_snapshot" :: held 4.349s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['4b645c62-f90c-4a00-a2e7-1af2d2d5a7ee', '0f915111-2573-4d9a-859c-6aa28008a134', 'e4af9804-a819-476a-b404-fd6abfa41b91', 'd3f8f2f4-108e-4f37-a87e-26883f2b20f7'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:51 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.903s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:17:51 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Converted 1024.00 MB image at 365.11 MB/s Apr 07 06:17:51 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 is being set with open permissions: ugo+rw Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:51 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 Apr 07 06:17:51 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['07a731f3-7089-4fb4-ab3f-d9896d3c5a1c', 'c3f2ad3a-6b9a-4749-9d99-eafb4ef2d756', 'f6129961-6672-456a-ab00-772c93baa9f9', '2f323a8e-e99d-48c6-983a-52ee7b85966f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:51 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:51 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:51 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Delete snapshot completed successfully. Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4dbe3c26-9b0d-44c7-85db-109b493a528f tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-b6d6d6c1-4d8a-4a3c-8510-277c8067d2ae-delete_snapshot" released by "delete_snapshot" :: held 4.528s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-18ba6118-12e0-4962-a016-24f125eead7e-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-18ba6118-12e0-4962-a016-24f125eead7e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-18ba6118-12e0-4962-a016-24f125eead7e" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-18ba6118-12e0-4962-a016-24f125eead7e" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d4377c-227c-444c-b0be-349efcb56623]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:51 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e Apr 07 06:17:52 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81" returned: 0 in 0.448s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" released by "_copy_volume_from_snapshot" :: held 5.476s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-35c61381-ab35-459f-beb3-df6f3a067c0c" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-35c61381-ab35-459f-beb3-df6f3a067c0c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Deleting offline snapshot 35c61381-ab35-459f-beb3-df6f3a067c0c of volume 0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] snapshot_file for this snap is: volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c3d8b-9574-4af6-bf32-d132a2b9c41c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.466s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:52 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4df1220d-acc3-4864-abcd-f629cc860c71 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-b6792339-ad38-4b43-98b7-f26fc6fd4688-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:52 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:52 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-95325fdd-62bc-48dd-8edf-523aac00441f-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:52 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-95325fdd-62bc-48dd-8edf-523aac00441f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:52 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e Apr 07 06:17:52 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e63c3-890e-4f3e-adf9-be04797deaed]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.492s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff932d4c-4242-46e9-91f3-1578a527de05]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f Apr 07 06:17:52 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:52 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-18ba6118-12e0-4962-a016-24f125eead7e" returned: 0 in 0.422s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-18ba6118-12e0-4962-a016-24f125eead7e" released by "delete_volume" :: held 0.953s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['3d809d18-08d5-45ad-a469-f0eb9341f69e', 'f77b2b52-0ff3-4791-992c-358e4cc57718', 'b8a1f677-2149-4f49-8703-ca7442f35729', 'dd00c61c-a787-4e7a-97b6-73434b6fe564'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:52 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:52 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:52 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f" returned: 0 in 0.464s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:52 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f Apr 07 06:17:53 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-15d74375-7c43-4099-b966-fb5cba08e672-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-15d74375-7c43-4099-b966-fb5cba08e672-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "cinder-quobyte-15d74375-7c43-4099-b966-fb5cba08e672" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-15d74375-7c43-4099-b966-fb5cba08e672" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aac5be-6ddc-4d2f-a74e-dbcdd64841b5]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.548s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 Apr 07 06:17:53 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:53 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.438s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-4cf963c6-8786-47f9-b7f6-a713b0e8a283 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-18ba6118-12e0-4962-a016-24f125eead7e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:53 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-95325fdd-62bc-48dd-8edf-523aac00441f" returned: 0 in 0.460s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-quobyte-95325fdd-62bc-48dd-8edf-523aac00441f" released by "delete_volume" :: held 0.952s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Created reservations ['3cf0611d-2291-4950-836b-c6db41c1b324', '2abfc6ac-4252-4d3c-9c20-a5319dd0ddf9', '6edcd90b-f975-4549-a307-ae98603c2f22', 'c90042c8-eac3-49a6-9186-53f17629d98c'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:53 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672" returned: 0 in 0.501s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672 Apr 07 06:17:53 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.509s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:53 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c Apr 07 06:17:53 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:53 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.455s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:53 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:53 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Deleted volume successfully. Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-33f540fc-7dab-4613-a71b-a0746d7ddbf3 tempest-CreateVolumesFromSnapshotTest-925226029 None] Lock "cinder-95325fdd-62bc-48dd-8edf-523aac00441f-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:54 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-15d74375-7c43-4099-b966-fb5cba08e672" returned: 0 in 0.476s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-quobyte-15d74375-7c43-4099-b966-fb5cba08e672" released by "delete_volume" :: held 0.998s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Created reservations ['87f970df-d914-4cac-9a3c-1964effeeab1', '243187f1-b2a2-4691-948c-200d04290746', '0695843c-217f-4233-b5eb-166f5c8a3502', 'c57a74e8-a9ca-4365-937a-3b1fe2b4bc47'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:54 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159.35c61381-ab35-459f-beb3-df6f3a067c0c" returned: 0 in 0.473s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-35c61381-ab35-459f-beb3-df6f3a067c0c" released by "_delete_snapshot" :: held 2.078s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.989s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-474255627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845808b6-3f2a-4d13-98e8-03feb4cd32d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c163a3e75744f29160c41f01f281d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:51Z,use_quota=True,user_id='0ff65df4f6c1400e92dd5b9b306fc6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)}" {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Creating volume 845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:54 devstack cinder-volume[83450]: INFO cinder.volume.drivers.remotefs [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] casted to osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 1073741824 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:54 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:54 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de52d46-a387-4f09-8f17-24df780531b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f23ee06-7904-4ecb-bfd6-274904751b81', 'volume_size': 1, 'source_volid': '0ba4a4aa-811e-43cc-8d47-e01a1a7f7159', 'source_volstatus': 'available'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d29e94-0cb3-4a45-bb53-697002c682ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:54 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Volume volume-9f23ee06-7904-4ecb-bfd6-274904751b81 (9f23ee06-7904-4ecb-bfd6-274904751b81): created successfully Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d29e94-0cb3-4a45-bb53-697002c682ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Flow 'volume_create_manager' (94db4958-19e8-457a-83a9-7bf16367d15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:54 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 1073741824 Apr 07 06:17:54 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d17b77d5-efcc-451b-8504-b02f1ce6d84c tempest-VolumeDependencyTests-1738738937 None] Created volume successfully. Apr 07 06:17:54 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.570s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:54 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Deleted volume successfully. Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-d26b70e6-547c-4f73-9c09-9513514d7352 tempest-CreateVolumesFromSourceVolumeTest-1676203649 None] Lock "cinder-15d74375-7c43-4099-b966-fb5cba08e672-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:54 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 1073741824" returned: 0 in 0.586s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:54 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:54 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:17:54 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" acquired by "delete_volume" :: waited 0.010s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2bebbb-f34c-47cd-a76e-ebe142c2f93d]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:55 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:55 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:55 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.497s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'} {{(pid=83450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8e29b9-af37-497a-a511-0768bf42b058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7', 'volume_size': 1}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44623536-f5d0-449f-af5a-d8af9ec87832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:55 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Volume volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 (845808b6-3f2a-4d13-98e8-03feb4cd32d7): created successfully Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44623536-f5d0-449f-af5a-d8af9ec87832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Flow 'volume_create_manager' (88c9da07-4b25-4406-993a-ec94ba368e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:55 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9f3a7592-fe8c-4de7-a64c-818ee2b7c9fe tempest-SnapshotDependencyTests-331478859 None] Created volume successfully. Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Creating offline snapshot ec3436fb-086a-4e27-9f5a-556121f3d5c9 of volume 845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa29f4b-6b11-41f0-85d4-0fd47b400ce4]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:55 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.569s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:55 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:55 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159 Apr 07 06:17:55 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:55 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:17:55 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:56 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" returned: 0 in 0.386s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159" released by "delete_volume" :: held 0.989s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:56 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.478s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 1G {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:56 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 1G Apr 07 06:17:56 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Created reservations ['3cfb34cb-7a70-45b3-8d6f-54ebc0ddc500', 'bf49e5fb-2a87-4253-b14f-21000f2db070', '14affbac-e3d2-4c6b-b138-e905d3fc5a14', '7c78f5a2-f271-4bc1-9546-bbce82fcd305'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:56 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:56 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:56 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 1G" returned: 0 in 0.462s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:56 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.406s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:56 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Deleted volume successfully. Apr 07 06:17:56 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:17:56 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:56 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-536f6e17-9b34-4353-ac0e-d2d3912d757b tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-0ba4a4aa-811e-43cc-8d47-e01a1a7f7159-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:57 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 -F qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.416s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:57 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 is being set with open permissions: ugo+rw Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:57 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:17:57 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-9f23ee06-7904-4ecb-bfd6-274904751b81-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-9f23ee06-7904-4ecb-bfd6-274904751b81-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" acquired by "delete_volume" :: waited 0.019s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e1ecb-6360-4ae0-95b0-537ea0bb9831]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:57 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 Apr 07 06:17:57 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:57 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.407s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:57 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info Apr 07 06:17:57 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:57 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81" returned: 0 in 0.456s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:57 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81 Apr 07 06:17:57 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:57 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info" returned: 0 in 0.434s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:57 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info is being set with open permissions: ugo+rw Apr 07 06:17:57 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:57 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info Apr 07 06:17:57 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:58 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-9f23ee06-7904-4ecb-bfd6-274904751b81" returned: 0 in 0.423s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-9f23ee06-7904-4ecb-bfd6-274904751b81" released by "delete_volume" :: held 0.906s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Created reservations ['1dcd101e-9356-433f-a260-f06f47d9e316', '187e22b0-1335-439e-b493-364c80ca779d', 'e0454354-5c49-4b3a-b74a-05fdc9e88ba9', '0465bfd7-1ec4-45ac-936b-d073a7542f80'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:58 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:58 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:58 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.info" returned: 0 in 0.446s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-dac07c46-5d13-44d0-9c5f-7a1a4852584f tempest-SnapshotDependencyTests-331478859 None] Create snapshot completed successfully Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b3a50-e00a-4cf0-b7d7-4896777fc975]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:58 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c Apr 07 06:17:58 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:58 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.439s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:58 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Deleted volume successfully. Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-29ec5d1a-0acc-41bb-aa4b-8389717e8bfd tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-9f23ee06-7904-4ecb-bfd6-274904751b81-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:58 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" returned: 0 in 0.483s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:58 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:58 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c Apr 07 06:17:58 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Flow 'volume_create_manager' (e60a2c32-8882-46b0-903d-53cf81c9160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737ec801-05b1-4063-b60d-0d6238405940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737ec801-05b1-4063-b60d-0d6238405940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3764eb72-9b2b-4160-bc7e-522400cc91c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c163a3e75744f29160c41f01f281d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec3436fb-086a-4e27-9f5a-556121f3d5c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:17:59Z,use_quota=True,user_id='0ff65df4f6c1400e92dd5b9b306fc6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49f36a-4bc1-4ad6-9922-4872829f8232),volume_type_id=fc49f36a-4bc1-4ad6-9922-4872829f8232)' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984a310b-4e15-48bb-afd2-47b3ec953875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984a310b-4e15-48bb-afd2-47b3ec953875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bdb012-e6d9-47ba-842d-85cd5830c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bdb012-e6d9-47ba-842d-85cd5830c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3764eb72-9b2b-4160-bc7e-522400cc91c8', 'volume_name': 'volume-3764eb72-9b2b-4160-bc7e-522400cc91c8', 'volume_size': 1, 'snapshot_id': 'ec3436fb-086a-4e27-9f5a-556121f3d5c9'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21e7d05-28d6-4294-b8b8-3717df764f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21e7d05-28d6-4294-b8b8-3717df764f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6800a50c-d089-44cb-9b32-bd96b518f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:17:59 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Volume 3764eb72-9b2b-4160-bc7e-522400cc91c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3764eb72-9b2b-4160-bc7e-522400cc91c8', 'volume_size': 1, 'snapshot_id': 'ec3436fb-086a-4e27-9f5a-556121f3d5c9'} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9-3764eb72-9b2b-4160-bc7e-522400cc91c8" by "_create_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9-3764eb72-9b2b-4160-bc7e-522400cc91c8" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Creating volume 3764eb72-9b2b-4160-bc7e-522400cc91c8 from snapshot ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Selected osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9 as target Quobyte volume. {{(pid=83450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" by "_copy_volume_from_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] snapshot: ec3436fb-086a-4e27-9f5a-556121f3d5c9, volume: 3764eb72-9b2b-4160-bc7e-522400cc91c8, {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865ec50-3891-46a0-9c4d-b7055bf8f1fc]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:59 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:17:59 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:59 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" returned: 0 in 0.410s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-quobyte-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c" released by "delete_volume" :: held 0.926s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Created reservations ['3337a637-ad19-4653-8b5e-f956146f50ea', '2c485d7d-5a2b-4127-b668-be8b0d591be7', '7d4bf6f7-4c23-46d8-9bb6-bf9acb6f7fb2', '8ada0fa4-f7e7-4450-a842-9d7af953215f'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:59 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:17:59 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:59 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.486s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Creating direct copy from snapshot {{(pid=83450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[052fa259-6cb2-4e5c-a47a-5836376b7fc0]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:17:59 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:17:59 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:17:59 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.467s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:17:59 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Deleted volume successfully. Apr 07 06:17:59 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-b4b6b98d-9289-4eaa-91a9-8b4b73ab4855 tempest-VolumeDependencyTests-1738738937 None] Lock "cinder-b4b4a13e-12e0-4fcf-a2e4-c8629f4e562c-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:00 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.532s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:00 devstack cinder-volume[83450]: DEBUG cinder.utils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Path /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 not found in is_blk_device check {{(pid=83450) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:18:00 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:00 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 Apr 07 06:18:00 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:02 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8" returned: 0 in 2.056s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dba6e3-78fc-4c8b-8b3d-6f908a138c12]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:02 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:18:02 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:02 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.558s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG cinder.image.image_utils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 {{(pid=83450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:18:02 devstack cinder-volume[83450]: INFO cinder.image.image_utils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Converted 1024.00 MB image at 497.85 MB/s Apr 07 06:18:02 devstack cinder-volume[83450]: WARNING cinder.volume.drivers.remotefs [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 is being set with open permissions: ugo+rw Apr 07 06:18:02 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:02 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 Apr 07 06:18:02 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:03 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8" returned: 0 in 0.379s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" released by "_copy_volume_from_snapshot" :: held 4.062s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9-3764eb72-9b2b-4160-bc7e-522400cc91c8" released by "_create_volume_from_snapshot" :: held 4.078s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.085s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6800a50c-d089-44cb-9b32-bd96b518f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3764eb72-9b2b-4160-bc7e-522400cc91c8', 'volume_size': 1, 'snapshot_id': 'ec3436fb-086a-4e27-9f5a-556121f3d5c9'}' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717ee8d2-e5cb-41ad-ade9-fa2f800f67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:18:03 devstack cinder-volume[83450]: INFO cinder.volume.flows.manager.create_volume [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Volume volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 (3764eb72-9b2b-4160-bc7e-522400cc91c8): created successfully Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717ee8d2-e5cb-41ad-ade9-fa2f800f67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83450) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:18:03 devstack cinder-volume[83450]: DEBUG cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Flow 'volume_create_manager' (e60a2c32-8882-46b0-903d-53cf81c9160f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83450) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:18:03 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-3e71cc8a-8600-4e81-ab93-6b58f8d3c4d8 tempest-SnapshotDependencyTests-331478859 None] Created volume successfully. Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-ec3436fb-086a-4e27-9f5a-556121f3d5c9-delete_snapshot" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-ec3436fb-086a-4e27-9f5a-556121f3d5c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" by "delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9" by "_delete_snapshot" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Deleting offline snapshot ec3436fb-086a-4e27-9f5a-556121f3d5c9 of volume 845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] snapshot_file for this snap is: volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e476061-7700-4941-a4f7-ab167e77145c]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:04 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:18:04 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:04 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.455s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.remotefs [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99ce87-f900-4979-9750-bac3c6a2c1ad]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:18:04 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:05 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:18:05 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:05 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.461s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:05 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:18:05 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:05 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.434s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:05 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:05 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9 Apr 07 06:18:05 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:06 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7.ec3436fb-086a-4e27-9f5a-556121f3d5c9" returned: 0 in 0.386s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-ec3436fb-086a-4e27-9f5a-556121f3d5c9" released by "_delete_snapshot" :: held 1.784s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" released by "delete_snapshot" :: held 1.796s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Created reservations ['b354cf41-89e9-4a43-8e98-3a1b3e8762fb', '47089a4f-c9e0-4f8d-8883-19d6bc1353cf', 'eecafb6b-14e3-4f42-9d55-6801e7067a0d', '800f55dc-382a-429e-916d-678fd5ff59fd'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:18:06 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Delete snapshot completed successfully. Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-823350a5-3584-4653-bd37-ee1579d48cf6 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-ec3436fb-086a-4e27-9f5a-556121f3d5c9-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-845808b6-3f2a-4d13-98e8-03feb4cd32d7-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-845808b6-3f2a-4d13-98e8-03feb4cd32d7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" acquired by "delete_volume" :: waited 0.008s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aaa068-2500-40ac-a039-c2f33a9cff9b]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:18:06 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:06 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:18:06 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:07 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.435s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:07 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7 Apr 07 06:18:07 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:07 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-845808b6-3f2a-4d13-98e8-03feb4cd32d7" returned: 0 in 0.379s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-845808b6-3f2a-4d13-98e8-03feb4cd32d7" released by "delete_volume" :: held 0.844s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=205,cinder:UPDATE=281,cinder:DELETE=23,cinder:INSERT=81 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=293,cinder:SELECT=209,cinder:INSERT=56,cinder:DELETE=29 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Created reservations ['708c5539-5319-4b8f-8133-f38ee3f461ef', '2453568a-92d4-4bfd-bbe0-e59c0454aabb', 'ec8c23dd-35fd-4775-94f1-2d8d486eadb3', '28ad4168-e1c2-4a47-bdfc-ff3ef23d2bd1'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:07 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:18:07 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-3764eb72-9b2b-4160-bc7e-522400cc91c8-delete_volume" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-3764eb72-9b2b-4160-bc7e-522400cc91c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" by "delete_volume" {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" acquired by "delete_volume" :: waited 0.007s {{(pid=83450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo.privsep.daemon [-] privsep: reply[425bbf07-d345-4ae1-bf9c-bb888befc904]: (4, 'qcow2') {{(pid=84091) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:07 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 Apr 07 06:18:07 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:07 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.411s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:18:07 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Deleted volume successfully. Apr 07 06:18:07 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-9e1a8848-fea0-49c1-88ca-885d296a98bc tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-845808b6-3f2a-4d13-98e8-03feb4cd32d7-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:08 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8" returned: 0 in 0.451s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:08 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8 Apr 07 06:18:08 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:08 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154/volume-3764eb72-9b2b-4160-bc7e-522400cc91c8" returned: 0 in 0.376s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-quobyte-3764eb72-9b2b-4160-bc7e-522400cc91c8" released by "delete_volume" :: held 0.848s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG cinder.quota [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Created reservations ['b7284c14-b12a-4cfc-aa2c-afebb0f85bd0', '494ac620-bd57-4956-b651-ebbfddbb80c5', 'ab08e2a6-13db-4a03-9fcf-f7066d6384b9', '2ed18cc0-28d0-4510-8963-6b2f1c8287db'] {{(pid=83450) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9': None} {{(pid=83450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG cinder.volume.drivers.quobyte [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9b48fab7-eb22-4123-85bc-57434997b5e9'] {{(pid=83450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.lockutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83450) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:18:08 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:18:08 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154 Apr 07 06:18:08 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:18:09 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Apr 07 06:18:09 devstack cinder-volume[83450]: DEBUG oslo_concurrency.processutils [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee9e43bf08b167c2d6002d7ecc0f5154" returned: 0 in 0.396s {{(pid=83450) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:18:09 devstack cinder-volume[83450]: DEBUG cinder.manager [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Notifying Schedulers of capabilities ... {{(pid=83450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:18:09 devstack cinder-volume[83450]: INFO cinder.volume.manager [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Deleted volume successfully. Apr 07 06:18:09 devstack cinder-volume[83450]: DEBUG cinder.coordination [None req-5da34bbc-e892-4e58-aff9-a740084ddc18 tempest-SnapshotDependencyTests-331478859 None] Lock "cinder-3764eb72-9b2b-4160-bc7e-522400cc91c8-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=83450) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:18:18 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:18:19 devstack cinder-volume[83450]: DEBUG dbcounter [-] [83450] Writing DB stats cinder:UPDATE=17,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83450) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}